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REAL PARTY IN INTEREST: 

The real party in interest is Siemens Audiologische Technik GmbH, a German 
company. 

RELATED APPEALS AND INTERFERENCES: 

There are no related appeals and no related interferences. 
STATUS OF CLAIMS: 

Claims 21-30 are the subject of the present appeal, and constitute all pending 
claims of the application. Claims 1-20 were cancelled during previous prosecution 
before the Examiner. No other claims were present in the application. 
STATUS OF AMENDMENTS: 

No amendment was filed following the final rejection. 
SUMMARY OF CLAIMED SUBJECT MATTER: 

Independent claims 20 and 26 are the only independent claims of the 
application, and are set forth below with exemplary citations to the specification and 
drawings for all relevant claim limitations therein. 

21. A method to automatically adjust a new hearing aid, comprising the 
steps of: 

temporarily bringing a first hearing aid (hearing aid 6 in Figs. 2, 3, 4, 5), 
having an acoustic input and an acoustic output and that has been 
worn by a hearing-impaired person, into active communication with a 
measurement device (plug 7 in the embodiment of Fig. 2; speaker 13 
and microphone 14 and measurement device 12 in the embodiments of 
Figs. 3, 4, 5) that is a separate device from, and is external to, said first 
hearing aid (p. 8, I. 16-19 and p. 9, I. 4-12); 



from a processor (PC 9 in Figs. 2, 3, 4, 5), operating said measurement 
device to obtain, by said active communication with said first hearing 
aid, a detected operational characteristic of said first hearing aid that 
represents overall operation of said first hearing aid between said 
acoustic input and said acoustic output of said first hearing aid (p. 8, i. 
16-26 and p. 9, I. 4-19); 

supplying said operational characteristic of said first hearing aid from said 
measurement device to said processor and, in said processor, 
automatically analyzing said operational characteristic of said first 
hearing aid to obtain an analysis result and automatically determining, 
fro said analysis result, setting parameters for electronic circuitry in a 
second hearing aid that is to replace said first hearing aid as a new 
hearing aid to be worn by said hearing-impaired person (p. 8, I. 22-26 
and p. 9, I. 13-19); 

temporarily placing said second hearing aid (hearing aid 11 in Figs. 2, 3, 4, 5) 
in active communication with a setting device (plug 10 and modem 8 in 
the embodiments of Figs. 2, 3; plug 10, modem 8, speaker 15, 
microphone 16 and measurement device 12 in the embodiment of Fig. 
4; speaker and microphone and measurement device 12 in the 
embodiment of Fig. 5) that is connected to said processor and that is a 
separate device from, and is external to, said second hearing aid (p. 8, 
I. 19-21 and p. 9, I. 22-25); and 
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from said processor, setting said electronic circuitry in said second hearing aid 
with said setting parameters via said active communication between 
said setting device and said second hearing aid (p. 8, I. 22-26 and p. 9, 
I. 23-27). 

26. An adjustment device to automatically adjust a new hearing aid, 
comprising: 

a measurement device (plug 7 in the embodiment of Fig. 2; speaker 13 and 
microphone 14 and measurement device 12 in the embodiments of 
Figs. 3, 4, 5) that is separate from but configured to temporarily interact 
with a first hearing aid (hearing aid 6 in Figs. 2, 3, 4, 5), having an 
acoustic input and an acoustic output and that has been worn by a 
hearing-impaired person, by active communication between the first 
hearing aid and the measurement device (p. 8, I. 16-19 and p. 9, I. 4- 
12); 

a processor (PC 9 in Figs. 2, 3, 4, 5) connected to said measurement device 
that operates said measurement device to obtain, by said active 
communication with said first hearing aid, a detected operational 
characteristic of said first hearing aid that represents overall operation 
of said first hearing aid between said acoustic input and said acoustic 
output of said first hearing aid (p. 8, I. 16-26 and p. 9, I. 4-19); 

said processor being configured to automatically analyze said operational 
characteristic of said first hearing aid to obtain an analysis result and to 
determine, from said analysis result, setting parameters for electronic 
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circuitry in a second hearing aid that is to replace said first hearing aid 
as a new hearing aid to be worn by said hearing-impaired person (p. 8, 

1. 22-26 and p. 9, I. 13-19); 

a setting device (plug 10 and modem 8 in the embodiments of Figs. 2, 3; plug 
10, modem 8, speaker 15, microphone 16 and measurement device 12 
in the embodiment of Fig. 4; speaker and microphone and 
measurement device 12 in the embodiment of Fig. 5) connected to said 
processor, that is separate from but configured to interact (p. 8, i. 19-21 
and p. 9, I. 22-25) with said second hearing aid (hearing aid 11 in Figs. 

2, 3, 4, 5) by temporary active communication between said setting 
device and said second hearing aid; and 

said processor operating said setting device to set said electronic circuitry in 
said second hearing aid with said setting parameters via said active 
communication between said setting device and said second hearing 
aid (p. 8, I. 22-26 and p. 9, i. 23-27). 

Figs. 1-5 as originally filed are submitted herewith as Exhibit A. 

GROUNDS OF REJECTION TO BE REVIEWED ON APPEAL: 

The following issues are presented for review in the present appeal: 
Whether the subject matter of claims 21, 22, 24-27 and 29-30 would have 
been obvious to a person of ordinary skill in the field of designing systems for setting 
parameters in hearing aids, under the provisions of 35 U.S.C. §103(a) , based on the 
teachings of United States Patent No. 6,035,050 (Weinfurtner et al., Exhibit B) in 
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view of the teachings of United States Patent Application Publication No. 
2002/0078161 (Cheng, Exhibit C); and 

Whether the subject matter of claims 23 and 28 would have been obvious to a 
person of ordinary skill in the field of designing systems for setting parameters in 
hearing aids, under the provisions of 35 U.S.C. §1 03(a) , based on the teachings of 
Weinfurtner et al. and Cheng and further in view of the teachings of United States 
Patent No. 5,825,894 (Shennib, Exhibit D). 
ARGUMENT: 

Rejection of Claims 21, 22, 24-27 and 29-30 under 35 U.S-C. §1 03(a) based on 
Weinfurtner et al and Cheng 

The method of independent claim 21 and the adjustment device of 
independent claim 26 are for the purpose of automatically setting a second hearing 
aid, which is to replace a first hearing aid worn by a user, with the same operating 
parameters that are in existence in the first hearing aid. This is for the purpose of 
alleviating the time-consuming procedure, often requiring the involvement of a 
trained audiologist, in order to set a replacement hearing aid for a user in a manner 
that conforms to the current hearing aid being worn by the user. 

As explained in the present specification, after a user has worn a particular 
hearing aid for a period of time, the user becomes accustomed to and comfortable 
with the settings for that hearing aid. If and when it is necessary to replace the 
person's current hearing aid with a replacement hearing aid, it is desirable, at least 
initially, to set the replacement hearing aid parameters to the same parameter 
settings as the user became accustomed to by wearing and using the first hearing 
aid. 



Conventionally, this was done by an audioiogist reading out the parameter 
settings from the first hearing and transferring the same setting to a second hearing 
aid, through a transfer procedure requiring the manual involvement of the 
audioiogist, and individual parameter-by-parameter setting of the replacement 
hearing aid. 

This conventional procedure is not needed in accordance with the subject 
matter of the claims on appeal, by virtue of the first hearing aid being temporarily 
brought into communication with a device that reads out and stores the parameter 
settings, and then temporarily bringing the second hearing device into 
communication with the setting device, so that those same parameters are then 
automatically used to set the replacement (second) hearing device. 

Appellants submit that the Weinfurtner et al. reference discloses setting 
parameters in only a single hearing aid, which is temporarily fitted with an auxiliary 
module 20 so as to place the hearing aid into communication with a control module. 
Via the control module and the temporarily-fitted auxiliary module, the settings of the 
hearing aid can be remotely changed. 

There is no disclosure in the Weinfurtner et al. reference to make use of such 
a procedure for any purpose other than setting the currently- worn hearing aid. 

The Cheng reference cited by the Examiner has nothing whatsoever to do 
with hearing aids, and is concerned with allowing non-UPnP (Universal Plug and 
Play) devices compatible with a conventional UPnP controller. As is clear from claim 
1 of the Cheng reference, the so-called bridge device or enabling device is merely a 
device that effects a transformation between a UPnP-compatible protocol and a non- 
UPnP-compatible protocol. There is no "setting" of any other device involved, the 



bridging device merely makes one device usable with another, without internally 
changing either device. 

The only reason why a system of the type disclosed in the Cheng reference 
might be used in combination with a hearing aid system would be if two hearing aids, 
or a hearing aid and a hearing aid controller, were, for some reason, not compatible 
with each other. Even if the Cheng reference were used for that purpose in such a 
context, there still is no teaching in either of the Cheng reference or the Weinfurtner 
et al. reference to make use of the transformation procedure disclosed in the Cheng 
reference for the purpose of automatically setting parameters in a replacement 
hearing aid to the same settings as were used in a currently-worn hearing aid, as 
disclosed and claimed in the present application. 

Appellants respectfully submit that it is clearly the case that the Examiner has 
relied on the Cheng reference, and, more likely, that the Examiner has even located 
the Cheng reference, only after reading Appellants' disclosure and being guided by 
the contents of Appellants' disclosure. This is clearly an impermissible manner to 
formulate a rejection under 35 U.S.C. §103(a) . 

More importantly, however, for the reasons noted above, even if the 
Weinfurtner et al. system were modified in accordance with the teachings of Cheng, 
the subject matter of the claims of the present application still would not result. 

Conversely, if a person of ordinary skill in the field of hearing aid design, 
seeking to solve the aforementioned problem of quickly and easily setting a 
replacement hearing aid to the same parameters as a currently-worn hearing aid, 
had the insight to make use of techniques relating to transforming a non- UPnP 
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device for use with a UPnP device, this would be an insight supporting patentability, 
rather than a reason for precluding patentability. 

In response to these arguments that were made during prosecution, the 
Examiner stated, in the Final Rejection dated April 19, 2010, that the Weinfurtner 
reference discloses, in Fig. 2, that there "could be another hearing aid . . . where the 
parameters could be set by control module 40." Appellants respectfully submit that 
the Weinfurtner et al. reference does not provide any such disclosure. 

Figure 2 of the Weinfurtner et al. reference merely shows a different 
embodiment from the embodiment of Fig. 1. In the embodiment of Fig. 1 of 
Weinfurtner et al., a behind-the-ear hearing aid 10 is shown as being fitted to the 
auxiliary module 20, and in the embodiment of Fig. 2 an in-the-ear hearing aid 10' is 
shown as being electrically connected to the auxiliary module 20. In each 
embodiment, however, it is only the hearing aid 10, or the hearing aid 10', that is set 
with parameters remotely via the control module 40. There is no disclosure 
whatsoever in Weinfurtner et al. of transferring parameters between these two 
different types of hearing aids, and in fact those of ordinary skill in the field of hearing 
aid design would know that this is not a realistic possibility because the microphone, 
that detects incoming audio signals, and the earphone, that emits an output audio 
signal to the hearing aid wearer, are each located at different locations in the case of 
a behind-the-ear hearing aid as opposed to an in-the-ear hearing aid. Therefore, 
those of ordinary skill in the field of hearing aid design would know in advance that 
parameter settings for a behind-the-ear hearing aid could not be expected to be 
automatically transferred for use in an in-the-ear hearing aid. Even if basic settings 
might be expected to be similar for these two different types of hearing aids with 
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regard to the same hearing-impaired person, those of ordinary skill in the field of 
hearing aid design know that those basic settings would still require adjustment, in 
view of the different locations of the microphone and the earphone, respectively, in 
those two different types of hearing aids. 

Also in response to the aforementioned arguments that were made during 
previous prosecution, the Examiner, in the April 9, 2010 Final Rejection stated that 
the UPnP message enabling device disclosed in the Cheng reference is capable of 
"preprocessing in one device and sending that preprocess to another device where it 
can be executed." The Examiner stated that, for example, a noise compensation 
algorithm in one computer could be sent to another computer where the noise 
compensation algorithm can be utilized and executed the same way it was in the 
previous computer. The Examiner stated that based on that analysis, the 
combination of Weinfurtner et al. and Cheng is not hindsight. 

Appellants respectfully submit this statement of the Examiner is evidence in 
support of the Appellants' non-obviousness position, rather than the Examiner's 
position regarding obviousness. Appellants' acknowledge that one basic premise of 
a "plug and play" system is that programs in one component of the system can be 
transferred in tact to another component of the system, and then used in that other 
component. This transfer is based on the further premise, however, that no 
adjustment or modification of the transferred program will be necessary for use in the 
device to which the program is transferred. Therefore, the message enabling device 
disclosed in the Cheng reference merely allows slightly differing component formats 
to be made compatible with each other, so that the transfer can take place. The 
actual program that is transferred, however, is transferred intact from one component 
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of the system to the other. This is in contrast to the explicit language of each of 
independent claims 21 and 26, which requires that the processor automatically 
analyze an operational characteristic of the first hearing aid, in order to obtain an 
analysis result, and then makes use of that analysis result to automatically determine 
setting parameters for electronic circuitry in the second hearing aid. Therefore, the 
subject matter disclosed and claimed in the present application clearly does not 
simply transfer one set of parameters intact from the first hearing aid to the second 
hearing aid, but instead performs an analysis on the parameters measured in the 
first hearing aid, so as to determine appropriate setting parameters therefrom for use 
in the second hearing aid. 

The fact that the Examiner has ignored this explicit language in claims 21 and 
26 substantiates Appellants' conclusion that the Examiner has selected and 
combined the Weinfurtner et al. and Cheng et al. references solely after reading 
Appellants' disclosure, and has not undertaken a careful comparison of the actual 
claim language with regard to the teachings of those respective references. 

The Federal Circuit stated in In re Lee 227 F.3d 1338, 61 U.S.P.Q. 2d 1430 
(Fed. Cir. 2002) : 

"The factual inquiry whether to combine references must be thorough 
and searching. ...It must be based on objective evidence of record. 
This precedent has been reinforced in myriad decisions, and cannot be 
dispensed with." 

Similarly, quoting C.R Bard, Inc. v. M3 Systems, Inc., 157 F.3d 1340, 1352, 
48 U.S.P.Q. 2d 1225, 1232 (Fed. Cir. 1998) , the Federal Circuit in Brown & 
Williamson Tobacco Court v. Philip Morris, Inc., 229 F.3d 1120, 1124-1125, 56 
U.S.P.Q. 2d 1456, 1459 (Fed. Cir. 2000) stated: 
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[A] showing of a suggestion, teaching or motivation to combine the 
prior art references is an 'essential component of an obviousness 
holding'. 

In In re Dembiczak, 175 F.3d 994,999, 50 U.S.P.Q. 2d 1614, 1617 (Fed. Cir. 

1999) the Federal Circuit stated: 

Our case law makes clear that the best defense against the subtle but 
powerful attraction of a hindsight-based obviousness analysis is 
rigorous application of the requirement for a showing of the teaching or 
motivation to combine prior art references. 

Consistently, in In re Rouffet, 149 F.3d 1350, 1359, 47 U.S.P.Q. 2d 1453, 

1459 (Fed. Cir. 1998) , the Federal Circuit stated: 

[E]ven when the level of skill in the art is high, the Board must identify 
specifically the principle, known to one of ordinary skill in the art, that 
suggests the claimed combination. In other words, the Board must 
explain the reasons one of ordinary skill in the art would have been 
motivated to select the references and to combine them to render the 
claimed invention obvious. 

,n Winner International Royalty Corp, v. Wang, 200 F.3d 1340, 1348-1349, 53 

U.S.P.Q. 2d 1580, 1586 (Fed. Cir. 2000) , the Federal Circuit stated: 

Although a reference need not expressly teach that the disclosure 
contained therein should be combined with another, ... the showing of 
combinability, in whatever form, must nevertheless be clear and 
particular. 

Lastly, in Crown Operations International, Ltd. y. Solutia, Inc., 289 F.3d 1367, 

1376, 62 U.S.P.Q. 2d 1917 (Fed. Cir. 2002) , the Federal Circuit stated: 

There must be a teaching or suggestion within the prior art, within the 
nature of the problem to be solved, or within the general knowledge of 
a person of ordinary skill in the field of the invention, to look to 
particular sources, to select particular elements, and to combine them 
as combined by the inventor. 

Appellants submit that the decision of the United States Supreme Court in 
KSR International Co. y. Teleflex Inc., 550 U.S. 398, 127 S.Ct. 1727, 82 U.S.P.Q. 2d 
1385 (2007) , and the United States Patent and Trademark Office guidelines for 
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applying that decision, support the position of the Appellants. That decision, 
although stating that it is not always required to point to a specific teaching in a prior 
art reference in order to substantiate a rejection under 35 U.S.C. §1 03(a) , by no 
means approved ignoring the above long-standing precedent, and certainly did not 
represent a blanket overruling of that precedent. In the KSR decision, the Supreme 
Court stated, under certain circumstances, it may not be necessary to point to a 
specific passage in a prior art reference as evidence of motivation, guidance or 
inducement in order to modify that reference in a manner that obviates the patent 
claim in question. The Supreme Court stated that if a person of ordinary skill in the 
art can implement a predictable variation and would see the benefit of doing so, 
Section 103(a) likely bars patentability. 

Nevertheless, the Supreme Court also stated that the requirement to find a 
teaching, suggestion or motivation in the prior art "captures a helpful insight." The 
Supreme Court stated that although common sense directs caution as to a patent 
application claiming as innovation the combination of two known devices according 
to their established functions, it can be important to identify a reason that would have 
prompted a person of ordinary skill in the art to combine the elements as the new 
invention does. The Supreme Court, however, stated that not every application 
requires such detailed reasoning. The Supreme Court stated that helpful insights 
need not become rigid and mandatory formulas. The Supreme Court only stated 
that if the requirement to find a teaching, suggestion or motivation is required in such 
a rigid, formulaic manner, it is then inconsistent with the precedence of the Supreme 
Court. In fact, the Supreme Court stated that since the "teaching, suggestion or 
motivation" test was devised, the Federal Circuit doubtless has applied it in accord 
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with these principles in many cases. The Supreme Court stated there is no 
necessary inconsistency between this test and an analysis conducted under the 
standards of Graham v. Deere. The Supreme Court stated the only error is 
transforming this general principle into a "rigid rule limiting the obviousness inquiry." 

Therefore, Appellants submit this decision of the Supreme Court does not in 
any manner approve, much less require, the absence of a rigorous evidentiary 
investigation on the part of the Examiner in order to substantiate most rejections 
under 35 U.S.C. §1 03(a) . Only under the somewhat unusual, and very limited, 
circumstances outlined by the Supreme Court in the KSR decision might the 
Supreme Court excuse the absence of such a rigorous evidentiary investigation in 
reaching a conclusion of obviousness under 35 U.S.C. §103(a) . 

This view of the KSR decision has been substantiated by the United States 
Court of Appeals for the Federal Circuit in Takeda Chemical Industries Limited v. 
Alphapharm Ptv. Ltd., 492 F.3d 1350, 83 U.S.P.Q.2d, 169 (Fed. Cir. 2007) , which 
was one of the earliest decisions of the Federal Circuit after the KSR decision was 
decided by the Supreme Court. The Takeda decision concerned a chemical patent 
that was the subject of an infringement lawsuit, and which was attacked by the 
infringer on the basis of the claimed subject matter being "obvious to try." After 
acknowledging that the KSR decision held that the teaching-suggestion-motivation 
test should not be applied rigidly, the Federal Circuit stated that the KSR decision 
actually recognized the value of that test in determining whether the prior art 
provided a reason for one of skill in the art to make the claimed combination. The 
Federal Circuit stated this is consistent with the Federal Circuit precedent in In re 
Dillon, 919 F.2d 688 (Fed. Cir. 1990) and in In re Deuel, 51 F.3d 1552 (Fed. Cir. 
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1995) . The Federal Circuit stated that in cases involving new chemical compounds, 



it remains necessary to identify some reason that would have led a chemist to modify 

a known compound in a particular manner to establish prima facie obviousness of 

the new claimed compound. In the Takeda decision, the Federal Circuit stated: 

The KSR Court recognized that "[w]hen there is a design need or 
market pressure to solve a problem and there are a finite number of 
identified, predictable solutions, a person of ordinary skill has good 
reason to pursue the known options within his or her technical grasp," 
KSR, 127 S.Ct. at 1732 . In such circumstances, "the fact that a 
combination was obvious to try might show that it would obvious under 
§103." id. that is not the case here. Rather than identify predictable 
solutions for antidiabetic treatment, the prior art disclosed a broad 
selection of compounds, any one of which could have been selected as 
a lead compound for further investigation. 

For the foregoing reasons, Appellants respectfully submit the Examiner has 
not properly substantiated the rejection of independent claims 1 and 26 under 35 
U.S.C. §1 03(a) based on Weinfurtner et al. and Cheng. 

Appellants' above arguments are applicable as well to the rejection of claims 
22, 24, 25, 27, 29 and 30, respectively depending from independent claims 1 and 26, 
in view of the statements of the Federal Circuit in In Re Fine, 837 F.2d 1071, 1076 
(Fed. Cir. 1988) (If an independent claim is not obvious under U.S.C. §1 03(a), then 
any claim depending therefrom is non-obvious). 

Rejection of Claims 23 and 28 under 35 U.S.C, §1 03(a) based on Weinfurtner et 
al, Cheng and Shennib 

The Examiner relied on the Shennib reference as disclosing a hearing aid that 
is capable of analyzing input signals and generating an ear canal transfer function for 
the user. Appellants acknowledge that the Shennib reference provides this general 
teaching, but in substantiating the rejection of claims 23 and 28 based on 
Weinfurtner et al., Cheng and Shennib, the Examiner stated that the "combined 
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teachings" of Weinfurtner et al. and Cheng disclose the use of a measurement 
device comprising a speaker and microphone, and Appellants respectfully submit 
that no such teaching is present in the "combined teachings" of Weinfurtner et al. 
and Cheng. 

In the rejection of independent claims 21 and 26, the Examiner relied on the 
auxiliary module 20 of Weinfurtner et al. as allegedly corresponding to the 
measurement device in those independent claims. In each of dependent claims 23 
and 28, this measurement device is further defined as including a speaker and a 
microphone. The auxiliary module 20 disclosed in the Weinfurtner et al. reference, 
however, is clearly a plug-in component, and there is no disclosure whatsoever in 
Weinfurtner et al. that the auxiliary module includes, or even could include, a 
speaker and a microphone. In column 4, line 44 of Weinfurtner et al., it is stated that 
the auxiliary module 20, in the embodiment of Fig. 1, is "detachably plugged" to the 
hearing aid 10 that is worn behind the ear. At column 4, line 45, it is further stated 
that the hearing aid 10 and the auxiliary module 20 are "electrically connected with 
one another via contact surfaces." This clearly does not and cannot involve a 
speaker/microphone arrangement of the type set forth in claims 21 and 28. 

In the embodiment of Weinfurtner et al. shown in Fig. 2, concerning the 
behind-the-ear hearing aid 10', Weinfurtner et al. state at column 4, lines 55-59, that 
the auxiliary module is connected to the hearing aid 10' via a connection line 12 that 
is detachably connected to the hearing aid 10' by means of known connection 
elements (plugs/sockets, etc.), as are used for the hard-wired programming of 
hearing aids. This again clearly teaches away from the use of a microphone/speaker 
arrangement. 
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Therefore, even if the Weinfurtner et al./Cheng combination were further 
modified in accordance with the teachings of Shennib, the subject matter of claims 
23 and 28 still would not result. Therefore, neither of those claims would have been 
obvious to a person of ordinary skill in the field of designing systems for setting 
parameters in hearing aids, under the provisions of 35 U.S.C. 5103(a) , based on the 
teachings of Weinfurtner et al., Cheng and Shennib. 
CONCLUSION: 

For the foregoing reasons, Appellants respectfully submit the Examiner is in 
error in fact and in law in rejecting the claims on appeal. Reversal of those rejections 
is proper, and the same is respectfully requested. 

This Appeal Brief is accompanied by electronic payment in the amount of 
$540.00 for the requisite fee. 

The Commissioner is hereby authorized to charge any additional fees which 
may be required, or to credit any overpayment to Account No. 501519. 

Submitted by, 

/STEVEN H. NOLL/ (Reg. 28,982) 

STEVEN H. NOLL 
SCHIFF, HARDIN LLP 
CUSTOMER NO. 26574 

Patent Department 
233 South Wacker Drive 

Suite 6600 
Chicago, Illinois 60606 
Telephone: 312/258-5790 
Attorneys for Appellant(s). 
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CLAIMS APPENDIX 

21. A method to automatically adjust a new hearing aid, comprising the 
steps of: 

temporarily bringing a first hearing aid, having an acoustic input and an 
acoustic output and that has been worn by a hearing-impaired person, 
into active communication with a measurement device that is a 
separate device from, and is external to, said first hearing aid; 

from a processor, operating said measurement device to obtain, by said 
active communication with said first hearing aid, a detected operational 
characteristic of said first hearing aid that represents overall operation 
of said first hearing aid between said acoustic input and said acoustic 
output of said first hearing aid; 

supplying said operational characteristic of said first hearing aid from said 
measurement device to said processor and, in said processor, 
automatically analyzing said operational characteristic of said first 
hearing aid to obtain an analysis result and automatically determining, 
fro said analysis result, setting parameters for electronic circuitry in a 
second hearing aid that is to replace said first hearing aid as a new 
hearing aid to be worn by said hearing-impaired person; 

temporarily placing said second hearing aid in active communication with a 
setting device that is connected to said processor and that is a 
separate device from, and is external to, said second hearing aid; and 
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from said processor, setting said electronic circuitry in said second hearing aid 
with said setting parameters via said active communication between 
said setting device and said second hearing aid. 

22. A method as claimed in claim 21 wherein said first hearing aid has a 
memory in which setting parameters for electronic circuitry in said first hearing aid 
are stored, and wherein the step of obtaining said operational characteristic from 
said first hearing aid comprises reading out said setting parameters from said 
memory of said first hearing aid and supplying said setting parameters read from the 
memory of the first hearing aid to said processor, and wherein said second hearing 
aid has a memory connected to said electronic circuitry of said second hearing aid, 
and wherein the step of setting said electronic circuitry in said second hearing aid 
with said setting parameters determined from said operational characteristic of said 
first hearing aid comprises entering the setting parameters read from said memory of 
said first hearing aid into said memory of said second hearing aid. 

23. A method as claimed in claim 21 wherein said measurement device 
comprises a speaker and a microphone, and wherein the step of obtaining said 
operational characteristic of said first hearing aid comprises emitting an acoustic 
signal from said speaker into said acoustic input of said first hearing aid and 
detecting an acoustic signal with said microphone from said acoustic output of said 
first hearing aid, and wherein the step of automatically analyzing said operational 
characteristic of said first hearing aid comprises automatically identifying, as said 
analysis result, a transfer function of said first hearing aid, between said acoustic 
input and said acoustic output, as a ratio of said signal supplied to said acoustic 
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input of said first hearing aid and said signal emitted from said acoustic output of 
said first hearing aid. 

24. A method as claimed in claim 21 wherein said measurement device is 
a first measurement device, and comprising placing said second hearing aid in active 
communication with a second measurement device, and operating said second 
measurement device from said processor to obtain an operational characteristic 
representing overall operation of said second hearing aid between an acoustic input 
thereof and an acoustic output thereof. 

25. A method as claimed in claim 24 comprising, in said processor, 
automatically analyzing said operational characteristic of said second hearing aid 
and, from said operational characteristic of said second hearing aid, automatically 
determining modified setting parameters and, from said processor, re-adjusting said 
second hearing aid according to said modified setting parameters via said active 
communication between said second hearing aid and said setting device. 

26. An adjustment device to automatically adjust a new hearing aid, 
comprising: 

a measurement device that is separate from but configured to temporarily 
interact with a first hearing aid, having an acoustic input and an 
acoustic output and that has been worn by a hearing-impaired person, 
by active communication between the first hearing aid and the 
measurement device; 

a processor connected to said measurement device that operates said 
measurement device to obtain, by said active communication with said 
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first hearing aid, a detected operational characteristic of said first 
hearing aid that represents overall operation of said first hearing aid 
between said acoustic input and said acoustic output of said first 
hearing aid; 

said processor being configured to automatically analyze said operational 
characteristic of said first hearing aid to obtain an analysis result and to 
determine, from said analysis result, setting parameters for electronic 
circuitry in a second hearing aid that is to replace said first hearing aid 
as a new hearing aid to be worn by said hearing-impaired person; 

a setting device connected to said processor, that is separate from but 
configured to interact with said second hearing aid by temporary active 
communication between said setting device and said second hearing 
aid; and 

said processor operating said setting device to set said electronic circuitry in 
said second hearing aid with said setting parameters via said active 
communication between said setting device and said second hearing 
aid. 

27. An adjustment device as claimed in claim 26 wherein said first hearing 
aid has a memory in which setting parameters for electronic circuitry in said first 
hearing aid are stored, and wherein said processor operates said measurement 
device to obtain said operational characteristic from said first hearing aid by reading 
out said setting parameters from said memory of said first hearing aid, and wherein 
said second hearing aid has a memory connected to said electronic circuitry of said 
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second hearing aid, and wherein said processor operates said setting device to said 
electronic circuitry of said second hearing aid with said setting parameters 
determined from said operational characteristic of said first hearing aid by entering 
the setting parameters read from said memory of said first hearing aid into said 
memory of said second hearing aid. 

28. An adjustment device as claimed in claim 26 wherein said 
measurement device comprises a speaker and a microphone, and wherein said 
processor operates said measurement device to obtain said operational 
characteristic of said first hearing aid by causing emission of an acoustic signal from 
said speaker into said acoustic input of said first hearing aid and by detecting an 
acoustic signal with said microphone from said acoustic output of said first hearing 
aid, and wherein said processor automatically analyzes said operational 
characteristic of said first hearing aid by automatically identifying, as said analysis 
result, a transfer function of said first hearing aid, between said acoustic input and 
said acoustic output, as a ratio of said signal supplied to said acoustic input of said 
first hearing aid and said signal emitted from said acoustic output of said first hearing 
aid. 

29. An adjustment device as claimed in claim 26 wherein said 
measurement device is a first measurement device, and comprising a second 
measurement device that interacts with said second hearing aid by active 
communication between said second measurement device and said second 
measurement device, and operates said second measurement device to obtain an 
operational characteristic representing overall operation of said second hearing aid 
between an acoustic input and an acoustic output of said second hearing aid. 
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30. An adjustment device as claimed in claim 29 wherein said processor is 
configured to automatically analyze said operational characteristic of said second 
hearing aid and, from said operational characteristic of said second hearing aid, 
automatically determine modified setting parameters and to operate said setting 
device to re-adjusting said second hearing aid according to said modified setting 
parameters via said active communication between said second hearing aid and said 
setting device. 
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[57] ABSTRACT 

A hearing aid system with a hearing aid has a matching 
arrangement with a first memory for several parameter sets 
available for selection for each of several hearing situations, 
an input unit for selecting a current hearing situation and for 
selecting one of the several parameter sets available for this 
hearing situation, and a second memory for allocation data 
that identify the parameter sets selected for each hearing 
situation. For the determination of an optimal parameter set 
for each of several hearing situations, an optimal user- 
specific parameter set is allocated to each hearing situation 
as it arises during an optimization phase. After the optimi- 
zation phase, the allocation data are evaluated for the 
determining an optimal parameter set for each hearing 
situation. This parameter set is then permanently pro- 
grammed as the parameter set which will be called to set the 
transmission characteristics of the hearing aid whenever the 
hearing situation allocated thereto occurs. 

15 Claims, 3 Drawing Sheets 
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PROGRAMMABLE HEARING AID SYSTEM to enable for the first time, the determination of parameter 

AND METHOD FOR DETERMINING se ts that are individually optimally matched to different 

OPTIMUM PARAMETER SETS IN A hearing situations in a hearing aid. 

HEARING AID Th e above object is achieved in accordance with the 

5 principles of the present invention in a hearing aid system 

BACKGROUND OF THE INVENTION having a programmable hearing aid with a signal transmis- 

. sion path therein including a signal processor which sets 

1. Field of the Invention transmission characteristics in the signal path dependent on 
The present invention is directed to programmable hear- a stored parameter set. The parameter set is stored in a 

ing aid system, as well as a method for determining optimum 1Q memory in the programmable hearing aid, and the system 

parameter sets in a hearing aid. also includes matching means, having access to the memory 

2. Description of the Prior Art in the hearing aid, for allocating respective parameter sets to 
In a programmable hearing aid several parameter sets are different hearing situations. The memory means includes a 

generally stored so as to be selectable by the user. These fi rst memory for storing a number of different parameter 

parameter sets being known as hearing programs. Each of 15 se ts, input means for identifying a number of different 

these parameter sets represents the settings, cooperatively hearing situations and for allowing a wearer of the hearing 

matched to one another, of all signal processing parameters aid t0 and allocate a parameter set for each hearing 

for a particular acoustic hearing or environmental situation situation each time it occurs. In a training phase, the hearing 

(e.g. an environmental situation "quiet," i.e. without disturb- situations may each arise at a number of different times, and 

ing background noise, or an environmental situation with 20 each time the wearer of the hearing aid makes an allocation 

low-frequency disturbing noise, etc.). The wearer of the of a parameter set to the current hearing situation. These 

hearing aid can select the suitable hearing program. allocations, produced over time during the training phase, 

A programmable hearing aid of this sort is known from are siorcd ™ a ^ memor y- A k c ° ntr01 pr0CeSsin f 

Europearn Application 0 064 042. This hearing aid has a me , ans e / alua u tes * he actions in the ?*ond mem0 ^ such 

microphone, an earphone, a signal processor and a param- 25 a * based on their frequency, for assigning a parameter set to 

4 tt * • u* ♦ * u • ♦ each hearing situation dependent on these allocations. For 

eter memory. Up to eight parameter sets can be written into . r , , ..... A , 

f , j* , man „ ° r „' , n • , t>„ example, tor each hearing situation, the control and process- 

the memory by means ot an external programming unit. By r . , ° - r 

4U 4 t . c u *u . a JT ♦ ♦ n a ing means can identify the parameter set most frequently 

the actuation of a switch, the stored parameter sets are called ? , « , . / . J 

ft t . , r j ♦ *u • i selected by the user as being appropriate for that heanng 

one after the other and are supplied to the signal processor. J , , ° ^ F . , & 

The user can thus match the signal transmission function of 30 Nation, *nd the control and processing means then per- 

the signal processor optimally to the current hearing situa- manently allocates that parameter set to that hearing situa- 

t - on tion m the parameter set memory in the programmable 

hearing aid. This configures the hearing aid so that, in the 

In this known heanng aid system, the parameter set future, each time that hearing situation arises, the hearing aid 

allocated to each heanng situation is determined during the ^ Mentify the hearing situation and selecl the allocatcd 

adaptation of the hearing aid, i.e. by a hearing aid acousti- parameter set for ^ in ^ning the transmission character- 

cian. It is difficult, however, to determine the optimal istics as long as that headng situation preV ails. 

parameter set for different acoustic environmental situations since the eter ^ mem in the programmable 

of the hearing-impaired person m this manner, since the ^ M Q ^ be medj Le thc contents thcrcof 

actual acoustic characteristic quantities hereof are finally can be a for tf ^ ^ fa impairment 

dependent on individual data. For example, if a hearmg aid c ^ term « anentl stored » as used in the 

wearer requires an in the car hearing program, because coQtext of ^ ameter ^ mem means that the allo . 

that person often travels in his or her own car an optimal Qf ^ x ^ meter sets are stored in the 

setting of the parameters for this program must be based on eter set mem so as t0 be unchanged unless and until 

he acoustic characteristic . quantities of that car, which in a ammi takes lace> ^ term « perm anently 

turn depend strongly on the type of car and other factors. store ^^ therefore, does not mean that the parameter set 

In order to avoid the complicated determination of a allocations are forever unalterable, 
suitable parameter set by the hearing aid acoustician, in the The above object fe als0 achieved in a melhod for dete r- 
hearing aid system disclosed in European Application 0 453 mining an optimal paramete r set for controlling the trans- 
450 an external control apparatus is provided that calculates 5Q mission charac t e ristics of a programmable hearing aid in 
signal processing parameters to be set from audiometnc each of a number of different hearing situations, wherein a 
data, m a complicated method, and calculates characteristic user wearing the hearing aid> in a tra i n i ng phaS e, experiences 
data from the environmental situation. This method is costly, a number of different hearing situations occurring at differ- 
however, and does not always produce an optimal parameter ent times> and for each hearing situal ion, the wearer of the 
set * 55 hearing aid selects one of a number of different trial param- 

An additional difficulty in the two above-cited methods e ter sets for use in that hearing situation, each time the 

for determining parameter sets is that even for identical hearing situation occurs. In this training phase, the alloca- 

hearing impairment (determined using a sound threshold tions of the different trial parameter sets to the different 

audiogram), the subjective sensations of different hearing hearing situations are stored, and after completion of the 

aid wearers can be different in identical acoustic environ- 60 training phase, these allocations are evaluated to perma- 

mental conditions, necessitating different optimal parameter nently assign one of the trial parameter sets to each hearing 

sets for the respective wearers. situation. The permanent assignment can be, for example, on 

<st tmmapy nv tup Tm/TNrnnN the basis of the frec l uenc y durin S the training phase by which 

SUMMARY OF THE INVENTION ^ heafing aid uger a partkular tdal parameter for 

It is an object of the present invention to avoid the above 65 a particular hearing situation. In a configuration phase, the 

problems associated with known hearing aids and hearing parameter set memory in the hearing aid is then configured 

aid systems, and in particular to simplify, or often in practice (programmed) based on the evaluation of the allocations so 
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as to permanently store one parameter set for each hearing preferably ensues either in an external evaluation computer 

situation. In the future operation of the hearing aid, when a or in the control module. Besides the evaluation, a constant 

particular hearing situation arises, the parameter set alio- monitoring of the allocation data also can take place only at 

cated thereto as being optimum when then be retrieved from the end of the matching phase, e.g. in order to determine 

the memory in the hearing aid, and used to set the trans- 5 whether no optimal trial parameter set is present for .a 

mission characteristics of the hearing aid, as long as that hearing situation, and the hearing aid acoustician must thus 

particular hearing situation prevails. be consulted to program new trial parameter sets. In an 

The programmable hearing aid can "identify" which of alternative embodiment, the matching means produces new 

the different hearing situations is currently in existence parameter sets according to predetermined rules, 

either by the user identifying that hearing situation, such as io T n a preferred embodiment, the hearing aid has a neural 

by a switch or by a remote control, or the programmable structure and a comparison and training circuit. The neural 

hearing aid can include a trainable network, such as a neural structure continuously evaluates acoustic input signals. The 

structure, which can, over time, "learn" when a particular comparison and training circuit makes it possible to train the 

hearing situation is present. The identification of the current neural structure according to the parameter sets selected for 

hearing situation is then undertaken fully automatically 15 each hearing situation during a training phase. After the 

within the hearing aid itself, without any necessity of conclusion of the training phase, the neural structure inde- 

intervention by the hearing aid wearer. pendently determines matching signal processing param- 

The invention is based on the fundamental concept of not eters from the input signals, so that the hearing aid user 

attempting to generate a predetermined parameter set alio- never again has to indicate the currently present hearing 

cated to each hearing situation of a programmable hearing 20 situation, 
aid during the adjustment by the hearing aid acoustician, but 

rather to make several trial parameter sets for each hearing BRIEF DESCRIPTION OF THE DRAWINGS 

situation available to the wearer at the time the wearer first FIG. 1 illustrates the arrangement of the components of an 

uses the hearing aid. In an optimization phase, so that the iavent ive hearing aid system in an embodiment with a 

hearing aid wearer can then determine which parameter set 25 behind-the-ear hearing aid 

is individually best suited for him or her in various indi- ___ . ... , t . 4 r .. c 

vidual hearing situations. This parameter set is then finally . .' 2 1 " ust ? tes th f arrangement of the components of an 

fixedly allocated to that hearing situation. mv ,? ntlve h ™ m % s y stem 10 an embodiment with an 



An advantage of the inventive solution is that the match- 
ing of the hearing aid to the various hearing situations is 
better achieved with conventional procedures, since it is 



in-the-ear hearing aid. 

FIG. 3 shows a view of an external control module used 
in the inventive system and method. 



individually oriented according to the real acoustic environ- FIG. 4 shows a block diagram of an auxiliary module used 
mental conditions of the personal life situations of the in the inventive system and method, 
hearing-impaired person. Moreover, the matching can FIG. 5 shows a block diagram of the external control 
largely be carried out by the hearing aid wearer, so that it is 35 module used in the inventive system and method, 
less costly. FIG. 6 shows a block diagram of a hearing aid with a 
In different embodiments of the invention, summarized neural structure used in the inventive system and method, 
below, the main functions of the matching means are dif- 
ferently distributed to different modules. DESCRIPTION OF THE PREFERRED 

In one embodiment at least the first memory for the trial EMBODIMENT 

parameter sets, the second memory for the allocations \ n FIG. 1, the outline of an ear is shown as a dotted line, 

decided on by the user, and the control and processing unit wjth a hearing aid 10 to be worn behind the ear, on which 

are provided in an external control module that is connected an auxiliary module 20 is detachably plugged. The hearing 

wirelessly with a mobile auxiliary module. The latter con- ^ aid 10 and the auxiliary module 20 are electrically connected 

tains a receiver that receives data from the control module with one another via contact surfaces. Via this connection, 

and forwards it to the hearing aid. parameter sets can be programmed into the hearing aid 10, 

In a second embodiment the modules identified in the first which sets determine the signal processing characteristic in 

embodiment are contained in the mobile auxiliary module, the hearing aid 10. The auxiliary module 20 permits the 

while the external control module essentially contains only 5Q exchange of data with an external control module 40 via a 

operational elements (i.e., input keys and a display), as well wireless data transmission path 24. 

as one or several interfaces. a modification of the hearing aid system shown in FIG. 

In a third embodiment, the modules can be grouped as in 1, FIG. 2 shows a hearing aid 10' to be worn in the ear that 

either the first or second embodiments but the auxiliary i s connected with the auxiliary module 20, to be worn 

module is omitted, and its functions are permanently inte- 55 behind the ear, via a connection line 12. The connection line 

grated into the hearing aid. 12 is detachably connected to the hearing aid 10' by means 

A fourth embodiment is constructed as described for the of known connection elements (plugs/sockets, etc.), as are 

third embodiment, but after the termination of the matching used, for example, for the hard-wired programming of 

phase, the control module serves as a normal remote control hearing aids. 

of the hearing aid. The matching functions are then deacti- 60 pjQ. 3 shows details of the operating and display elements 

vated. of the external control module 40, constructed in a manner 

In a fifth embodiment all modules of the matching means, similar to a remote control for electronic entertainment 
including the operational elements, are integrated into the systems. A display 42, constructed for example as an alpha- 
mobile auxiliary module, to be worn on the body. The numeric LCD display, serves for user control. For example, 
control module can be omitted. 65 the set hearing situation can be displayed in a first line (such 

The evaluation of the allocation data stored in the second as hearing situation 53: workplace in the example of FIG. 3), 

memory of the matching means during the matching phase and the respectively allocated parameter set can be displayed 
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in a second line (such as parameter set E2 in the example). distribution of the functions of the matching means among 

Other texts that were programmed in during the program- the auxiliary module 20 and to the control module 40, 

ming of the control module 40 can also be displayed. An individual modules can be omitted or can be simplified. The 

input unit 44, constructed as a keyboard or keypad, has computer interface 64 can be omitted if the entry of the trial 

several keys or pads, in particular keys 48 for setting the 5 parameter sets ensues via the input unit 44, and the evalu- 

hearing situation, keys 50 for the allocation of a parameter ation of the allocation data is carried out by the control and 

set to the hearing situation, a key 52 for confirmation and a processing unit 46. Moreover, the control and processing 

key 54 for the correction of erroneous inputs. In order to unit ,_ 46 for generating new or modified trial parameter sets 

organize the operation of the control module 40 simply, only c u an be *? U P according to rules that are programmed in or 

a few clearly identified keys without double functions are 10 that m fixedl y Predetermined. 

provided; for example, keys for a maximum of four hearing FIG - 6 shows the circmt of a complexly constructed 

situations, respectively with a maximum of four trial param- hearm § aid 10 or 10 '> specified m more detail below. For the 

eter sets, in the control module 40 shown in FIG. 3. previously described embodiments of the hearing aid 

rr. .,. j i *%t\ i_ • pjp A . • 4 _r system, a hearing aid 10 or 10' is sufficient, in which, of the 

The auxiliary module 20 shown in FIG. 4 has an interface ' „'„ #0 ovJ™ dtp < ,™ L^a-a 

~~ c .... , , . . . . • .j ic components shown in Flu. 6, there are provided only an 

22 tor bidirectional data transmission to the hearing aid 10 15 . f , - A ' . r , \ _ 

, int v . . 4J _ , . . , ^i-i^ input transducer 14 constructed as a microphone, an output 

(or 10) via contacts or via the electrical connection line 12. A *o . . j L • i 

A j * * .. . , n ~, c ju transducer 18 constructed as an earphone, a signal process- 

A data transmission interface 26, formed by an infrared . , ~, . At A . . \ 

, . . . , , . . ; . , ing stage 16 with a transmission characteristic determined 

light-emitting diode and a photosensor, serves to provide the , . , & , 4 r 

u-a- i j * * • • *u *>a * *u * i by the aforementioned parameters of a parameter set, a 

bidirectional data transmission path 24 to the external con- J onr v v . c t , . ' 

♦ i a i An tu a * 4 • • , u *>a • f ui ?n memory 80 for at least one parameter set of the signal 

trol module 40. The data transmission path 24 is preferably 2U . , , . A r ™ * i( P. 

wireless. Visible or infrared light, radio-frequency broadcast 
waves, ultrasound, electrical induction, etc., can be 

employed. The interfaces 22 and/or 26 can also be con- r , , , 

structed more simply as unidirectional interfaces that enable F ° r the configuring and optimization of the parameters of 

transmission of parameter sets only in the direction to the 25 the hearing aid, according to an exemplary embodiment of 

hearing aid 10 or 10' inventive method the heanng aid acoustician first deter- 

m , , . , , mines the hearing situations for which the wearer of the 

lne interfaces 22 and 26 are connected with one another, u -a ■ u ♦ ■ a- -a n a ♦ *u 

. , . . ~« rr, , heanng aid wishes to individually determine the parameter 



processing stage 16, and an interface 90 to the matching 
means. In an embodiment, the interface 90 is connected with 
the auxiliary module 20 via the electrical connection line 12. 



as well as with a control and processing unit 30. The latter 
enables access to several read-only memories and/or write/ 
read memories, in particular to a first memory 32 for the trial 



sets (also called hearing programs). Examples of hearing 
3 q situations might include: "at work," "conversing in the car," 
"listening to music at home," etc. For each of these hearing 



parameter sets and to a second memory 34 for the allocations situations , se Veral trial parameter sets are determined, 

chosen by the user during the optimization phase, n d dent on the heari impa i rm ent of the wearer of the 

addition, a module 36 for the production of a possibly hearf ajd usj matchi software that mm Qn the exter . 

required programming voltage for the hearing aid 10 or 10', nal evaluation computer . The determined parameter sets are 

as well as a power supply module 38, are provided. The transmitted to the control module 40 via the uter 

module 36 is connected to the connection line 12, and is iQterface M and afe either stored there fa the first m 

controlled by the contro and processing unit 30. The power 60 Qf afe transmitted via the data transmission path 

supply module 38 supplies all the named component and 24 tQ the auxili module ^ and are stored fa the fifst 

turthermore is connected with the heanng aid 10 or 10 via memory 32 thereof 

the connection line 12. 40 _ , , , , 

For the parameter optimization phase, the control module 

The auxiliary module 20 is shown m FIG. 4 m an 40 and the mobile auxiliary module 20 are provided to the 
embodiment with complete functionality. In other hearing-impaired person. If the hearingimpaired person is in 
embodiments, m which some functions are for example, a hearing situat ion typical for him or her, he or she can first 
taken over by the control module 40, some modules can be 45 select the headng situation via the control module by means 
omitted. For example, the first and second memories 32 and of the keys ^ and can subse quently respectively activate 
34 need only be provided either in the auxiliary module 20 C)ne of lhe trial parame t e r sets allocated thereto by means of 
or in the control module 40. The control and processing unit the keys 50 ^ ^ is now transmitted from the control 
30 can then be constructed more simply, or even can be raodule 40 t0 the mobile auxiHary module 20, is pro- 
omitted entirely. 5Q gramme d into the hearing aid 10 or 10' by this module, and 

FIG. 5 shows the construction of the external control is activated there. If the hearing-impaired person has found 

module 40, The display 42 and input unit 44, already the optimal set of parameters for the selected hearing 

described in connection with FIG, 3, are connected with a situation, he or she can store it by actuating the confirmation 

control and processing unit 46, to which are connected first key 52. That is, it is noted in the second memory 62 of the 

and second memories 60 and 62, a computer interface 64 55 control module 40 (in the second memory 34 of the auxiliary 

and a data transmission interface 68 to the auxiliary module module 20) that an allocation of this parameter set to the 

20. In addition, a power supply module 70 is provided for identified hearing situation has taken place, 

the named modules. The computer interface 64 is connected After the user's optimization phase is completed, the 

with a terminal 66 for an external evaluation computer. Via second memory 62 of the control module 40 (the second 

the computer interface 64, on the one hand trial parameter 60 mem ory 34 of the auxiliary module 20) is read out by the 

sets can be transmitted from the evaluation computer to the hearing aid acoustician, and it is determined the frequency 

control module 40 before the beginning of the optimization with which allocation of hearing situations to parameter sets 

phase, and, on the other hand, allocation data can be has been made. The parameter set with the most frequent 

transmitted from the control module 40 to the evaluation allocation for a particular hearing situation is stored as the 

computer after the termination of the optimization phase. 65 corresponding hearing program in the hearing aid 10 or 10' 

The control module 40 is also shown in FIG. 5 in an for thai hearing situation. This is done for each hearing 

embodiment with complete functionality. According to the situation. 
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The optimization phase is terminated, and it remains only herein by reference, in particular with respect to the con- 
fer the user to wear the hearing aid 10 or 10' (and no longer struction of the signal preparation unit 86 (see FIG. 3 of 
the matching means including the auxiliary module 20 and European Application 0 712 263, with the associated 
the control module 40). If the hearing aid system is designed specification) and the neural structure 82 (see FIG. 4 to FIG. 
so that the control module 40 communicates directly with 5 8 of European Application 0 712 263, with the associated 
the hearing aid 10 or 10', the control module 40 can then also specification). European Application G 712 263 does not, 
serve as a normal remote control of the hearing aid 10 or 10' however, describe how the training of the neural structure 82 
after the end of the optimization phase. The matching can take place. 

functions are then deactivated. In this version, the parameter According to the inventive system and method, trial 
sets determined in the optimization phase can remain stored 10 parameter sets are first determined for the training of the 
in the control module 40, which now acts as a remote neural structure 82, and thus for the programming of the 
control. Only the currently desired parameter set needs to be hearing aid system. During the optimization phase, the user 
transmitted to the hearing aid 10 or 10', so that the latter need first communicates the parameter set believed to be optimal 
have only a memory 80 for a single parameter set. f or the momentary hearing situation to the hearing aid 10 or 
If, upon completion of the user's optimization phase the 15 10', via the interface 90 in the way specified above. This is 
allocation frequency of some or all of the parameter sets is written into the memory 80. Independently of this, the neural 
too low to allow the acoustician to confidently assign structure 82 calculates a proposed parameter set from the 
significance for a hearing situation, the corresponding data originating from the signal preparation unit 86. 
parameter sets can be modified by the acoustician using the During the optimization phase, the comparison and train- 
matching software, and can be stored again in the control 20 ing c i rcu j t 88 continuously compares the parameter set 
module 40. The optimal allocation can then be determined believed to be optimal by the user and written into the 
again in a second optimization phase. memory 80, with the parameter set determined by the neural 
In an alternative embodiment of the inventive method, the structure 82. An error identifier is obtained from the devia- 
evaluation of the allocations of hearing situations to trial tions of these parameter sets according to a predetermined 
parameter sets ensues already during the optimization phase 25 algorithm (e.g. a learning algorithm for neural networks 
in the control module 40. A too low frequency of the according to the prior art). Based on this error identifier, the 
allocations of trial parameters to a particular hearing situa- comparison and training circuit modifies the parameters, 
tion is interpreted to mean that no optimal parameter set is contained in the memory 84, for the neural structure 82. In 
present for this hearing situation. The wearer of the hearing this way, the neural structure 82 is trained during the 
aid is then requested via the display 42 to consult his or her 30 optimization phase until it can by itself determine suitable 
hearing aid acoustician, in order to have new trial parameter parameter sets for each environmental acoustic condition, as 
sets programmed in. Alternatively, these new trial parameter it arises, with satisfactory precision, 
sets can be generated in the control module 40 according to At the beginning of the optimization phase (training 
fixedly predetermined rules or rules that can be programmed phase), the signal processing stage 16 receives its control 
in. parameters exclusively from the memory 80 for the para ru- 
in another variant embodiment of the invention, the Q ^ set entered by the user; as the training success 
hearing aid 10 or 10' is constructed according to FIG. 6. progresses, these parameters are increasingly taken from the 
Besides the components already specified above, this hear- neural structure 82. After the termination of the training 
ing aid 10 or 10' has a neural structure 82, also called a 4Q phase, the signal processing stage 16 continues to receive its 
neural network, a memory 84 for parameters of the neural control parameters only from the neural structure 82. The 
structure 82, a signal preparation unit 86 and a comparison matching means is then no longer needed by the hearing aid 
and training circuit 88. The signal preparation unit 86 is wearer. 

connected with the signal processing stage 16 at a suitable Although the present invention has been described with 

top point, and supplies suitably prepared signals to the 45 reference to a specific embodiment, those of skill in the art 

neural structure 82, which correspond to the items of acous- will recognize that changes may be made thereto without 

tic information received by the input transducer 14. departing from the scope and spirit of the invention as set 

The memory 84 contains parameters that control the forth in the appended claims, 

output behavior of the neural structure 82. The memory 84 We claim as our invention: 

is connected with the neural structure 82, as well as with the 50 A hearing aid system comprising: 

comparison and training circuit 88. The comparison and a programmable hearing aid having a housing adapted to 

training circuit 88 controls the neural structure 82, the be worn at an ear, said housing containing an input 

memory 84 for the neural structure 82 and the memory 80 transducer and an output transducer with a signal path 

for parameter sets. The outputs of the memory 80 or of the therebetween, signal processing means connected in 

neural structure 82 are connected with the comparison and 55 said signal path for influencing a signal in said signal 

training circuit 88, as well as with a parameter input of the path dependent on a parameter set, and a parameter set 

signal processing stage 16, via which the transmission memory accessible by said signal processor means for 

characteristic of the signal processing stage 16 can be set. By storing at least one parameter set for use by said signal 

means of the comparison and training circuit 88, it is processing means; 

determined among other things whether the outputs of the 60 identifier means in said housing for identifying a current 

neural structure 82, the parameters stored in the memory 80 hearing situation defining an environment in which said 

or a mixture of the two are used to control the signal programmable hearing aid is disposed; 

processing stage 16. matching means for allocating respective parameter sets 

From European Application 0 712 263, a hearing aid 10 in a plurality of parameter sets to different hearing 

or 10' is known in which the parameters controlling the 65 situations, said matching means including a first 

signal processing are determined by a neural structure. The memory for storing said plurality of parameter sets, 

content of European Application 0 712 263 is incorporated input means for identifying a current hearing situation 
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among a succession of hearing situations and for allow- 
ing a wearer of said hearing aid to select and allocate 
a parameter set, for said plurality of parameter sets, for 
each hearing situation each time it occurs, a second 
memory for storing respective allocations made by said 
user among said parameter sets and said hearing 
situations, and control and processing means for evalu- 
ating said allocations in said second memory for 
assigning a parameter set among said plurality of 
parameter sets to each hearing situation dependent on 
said allocations and for programming said parameter 
set memory with said parameter sets respectively allo- 
cated to said hearing situations, said parameter set 
memory then supplying to said hearing situations, said 
parameter set memory then supplying to said signal 
processing means, when a current hearing situation is 
identified by said identifier means, the parameter set 
allocated to the current hearing situation; and 
said matching means comprising an external control mod- 
ule, including at least said input means, and an auxil- 
iary module, said auxiliary module containing a 
remainder of said matching means not contained in said 
external control module, and means for wirelessly 
transmitting data at least from said external control 
module to said auxiliary module, said auxiliary module 
being temporarily mechanically connectable to said 
housing and adapted to be worn at an ear together with 
said housing during a matching procedure, consisting 
of a training phase and a hearing aid configuration 
phase, in which said respective parameter sets in said 
plurality of parameter sets are allocated to different 
hearing situations and being electrically connected to 
said signal processing means, and after said matching 
procedure said auxiliary module being removable from 
said housing. 

2. A hearing aid system as claimed in claim 1 wherein said 
auxiliary module contains an interface to said programmable 
hearing aid and a data transmission interface to said external 
control module, and wherein said external control module 
contains, in addition to said input means, said first and 
second memories, said control and processing means, and a 
data transmission interface to said auxiliary module. 

3. A hearing aid system as claimed in claim 1 wherein said 
auxiliary module contains an interface to said hearing aid, 
said first and second memories, said control and processing 
means, and a data transmission interface to said external 
control module, and wherein said external control module, 
in addition to said input means, contains a data transmission 
interface to said auxiliary module. 

4. A hearing aid system as claimed in claim 1 further 
comprising a remote control means for operating said pro- 
grammable hearing aid, including said identifier means, said 
remote control means containing said external control mod- 
ule. 

5. A hearing aid system as claimed in claim 1 wherein said 
matching means comprises an external control module, 
including at least said input means, and an auxiliary module 
contained in said programmable hearing aid, said auxiliary 
module containing a remainder of said matching means not 
contained in said external control module, and means for 
wirelessly transmitting data at least from said external 
control module to said auxiliary module. 

6. A hearing aid system as claimed in claim 5 wherein said 
auxiliary module contains an interface to said programmable 
hearing aid and a data transmission interface to said external 
control module, and wherein said external control module 
contains, in addition to said input means, said first and 
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second memories, said control and processing means, and a 
data transmission interface to said auxiliary module. 

7. A hearing aid system as claimed in claim 5 wherein said 
auxiliary module contains an interface to said hearing aid, 
said first and second memories, said control and processing 
means, and a data transmission interface to said external 
control module, and wherein said external control module, 
in addition to said input means, contains a data transmission 
interface to said auxiliary module. 

8. A hearing aid system as claimed in claim 5 further 
comprising a remote control means for operating said pro- 
grammable hearing aid, including said identifier means, said 
remote control means containing said external control mod- 
ule. 

9. A hearing aid system as claimed in claim 1 wherein said 
matching means includes display means for displaying an 
alphanumeric indication of said parameter sets and said 
different hearing situations. 

10. A hearing aid system as claimed in claim 1 further 
comprising means for determining an optimal allocation of 
each parameter set to each hearing situation from said 
allocations stored in said second memory. 

11. A hearing aid system as claimed in claim 10 wherein 
said means for determining an optimal allocation includes 
means for determining whether an optimal allocation of a 
respective parameter set to each hearing situation can be 
determined from said allocations stored in said second 
memory. 

12. A hearing aid system as claimed in claim 1 further 
comprising a neural structure, a neural structure memory for 
storing parameters for said neural structure, and comparison 
and training means for training said neural structure accord- 
ing to said parameter sets respectively allocated to said 
hearing situations, by modifying said parameters in said 
neural structure memory, 

13. A method for determining an optimal parameter set for 
controlling transmission characteristics of a programmable 
hearing, aid having a housing containing a signal processor, 
in each of a plurality of different hearing situations, com- 
prising the steps of: 

temporarily mechanically connecting an auxiliary module 
to said housing and temporarily electrically connecting 
said auxiliary module to said signal processor: provid- 
ing a remote control in a wireless communication with 
said auxiliary module; 

in a training phase, wearing said hearing aid and said 
auxiliary module by a user in said plurality of different 
hearing situations; 

in said training phase, making a plurality of different trial 
parameter sets from said auxiliary module available for 
selection by said user in each hearing situation each 
time a hearing situation each time a hearing situation 
occurs; 

in said training phase, for each hearing situation, said user 
selecting one of said trial parameter sets deemed opti- 
mal by said user and storing an allocation in said 
auxiliary module of said one of said trial parameter sets 
to the hearing situation for which it was deemed 
optimal; 

in a hearing aid configuration phase, evaluating all of the 
stored allocations of said trial parameter sets to the 
different hearing situations and remotely programming 
said hearing aid via said auxiliary module, using said 
remote control to assign one trial parameter set in said 
hearing aid to each hearing situation for controlling 
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said transmission characteristics of said hearing aid 
when said hearing situations respectively occur; and 
removing said auxiliary module from said housing. 
14. A method as claimed in claim 13 wherein the step of 
evaluating all of said stored allocations comprises evaluating 5 hearing aid to select a different trial parameter set. 
a frequency for which said user selected each trial parameter 
set for each hearing situation. 



15. A method as claimed in claim 13 comprising the 
additional step of identifying an allocation frequency of a 
parameter set to a hearing situation which is too low to be 
significant, and providing a message to said user of said 
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(57) ABSTRACT 
A bridging device couples an IP (Internet Protocol) network 
to one or more non-IP networks, in order to facilitate the 
control of non-UPnP (Universal Plug and Play) devices by 
a UPnP controller on the IP network. Each of the non-IP 
slave networks may employ different network technologies, 
such as USB, Bluetooth, HAVi, Home API, HomeRF, X-10, 
Jini, and so on. The bridging device includes an IP network 
interface for receiving commands and requests from the 
UPnP controller, and one or more slave network interfaces 
that transform the received commands and requests into 
device and network specific commands and requests. These 
device and network specific commands and requests are 
communicated to the controlled non-UPNP device, via the 
slave network, using the slave network's protocol. The 
bridging device also communicates event status messages to 
the UPnP controller, corresponding to the non-UPnP 
devices' response to the UPnP controller's commands and 
requests. The bridging device also includes enabling logic to 
support the UPNP addressing, discovery, and description 
processes for each of the devices on the non-IP network. To 
minimize the storage requirements at the bridging device, 
the bridging device is configure to use a file server that is 
also resident on an IP network, wherein the file server 
contains the detailed information required to effect the 
appropriate UPnP addressing, discovery, and description 
processes, and other information-laden tasks, as required. 
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UPNP ENABLING DEVICE FOR 
HETEROGENEOUS NETWORKS OF SLAVE 
DEVICES 

BACKGROUND OF THE INVENTION 
[0001] 1. Field of the Invention 

[0002] This invention relates to the field of control sys- 
tems, and in particular to the control of non-UPnP-compliant 
slave devices via a Universal Plug and Play (UPnP) object, 
or application. 

[0003] 2. Description of Related Art 

[0004] "Universal Plug and Play (UPnP) is an architecture 
for pervasive peer-to-peer network connectivity of intelli- 
gent appliances, wireless devices, and PCs of all form 
factors. It is designed to bring easy-to-use, flexible, stan- 
dards-based connectivity to ad-hoc or unmanaged networks 
whether in the home, in a small business, public spaces, or 
attached to the Internet. Universal Plug and Play is a 
distributed, open networking architecture that leverages 
TCP/IP and the Web technologies to enable seamless prox- 
imity networking in addition to control and data transfer 
among networked devices in the home, office, and public 
spaces." 

1 "Universal Plug and Play Device Architecture", Version 1.0, Jun. 8, 2000, 
© 1999-2000 Microsoft Corporation, incorporated by reference herein. 

[0005] Other networking solutions are also available for 
control and data transfer among networked devices in the 
home, office, and public spaces. Standards continue to be 
developed which will allow devices of varying types and 
varying vendors to be controlled by a common controller. 
The HAVi architecture, the Home API initiative, the Uni- 
versal Serial Bus (USB), HomeRF Lite, and the Bluetooth 
standard, each involving substantial contributions from Phil- 
ips Electronics, the OSGI/Jini technology of Sun Microsys- 
tems, Inc., and others, have been developed to enhance the 
interoperability of multiple devices in a network. 

[0006] Each of the available network solutions has par- 
ticular advantages and disadvantages. The USB interface, 
for example, is relatively inexpensive, and, as such, is 
incorporated into many computer peripheral devices, such as 
keyboards, mice, pointing devices, and so on. The USB also 
provides a fairly high speed connectivity at this low cost, 
and has been adopted as a standard interface for video 
information transfer, such as from a video camera. The USB, 
however, has a limited cable length specification of less than 
30 meters, and in some applications, less than 5 meters. The 
UPnP networking architecture, on the other hand, uses the 
TCP/IP protocol, which is currently used for world-wide 
communication networks, such as the world-wide-web. The 
TCP/IP, however, is a more capable, and hence more com- 
plex and costly protocol, which is typically embodied via a 
high speed Ethernet connection. Although TCP/IP is a viable 
networking solution for computers, high speed printers, 
servers, and the like, its inherent complexity does not 
encourage its use in consumer devices such as cameras, 
DVD players, recorders, and the like. In like manner, the 
Bluetooth standard supports the use of wireless devices in a 
networked environment, but is unsuitable for TCP/IP-based 
communications and control, such as provided by the UPnP 
standard. 

[0007] The advantages and disadvantages of each net- 
working solution are likely to result in a variety of networks 



being installed in a typical home or office environment. With 
the existence of multiple devices in a typical environment, 
there is an every increasing need for devices and systems 
that provide a bridge between and among such heteroge- 
neous networks. 

BRIEF SUMMARY OF THE INVENTION 

[0008] It is an object of this invention to provide a method 
and system for coupling IP networks with non-IP networks. 
It is a further object of this invention to provide a method 
and system that allows for the control of non-UPnP-com- 
pliant devices from a UPnP-compliant controller. It is a 
further object of this invention to enable the control of 
non-UPnP-compliant slave devices without modification to 
the slave devices. 

[0009] These objects and others are achieved by providing 
a bridging device that couples an IP network to one or more 
non-IP networks. Each of the non-IP networks may employ 
different network technologies, such as USB, Bluetooth, 
IEEE 1394, Home API, HomeRF, Firefly, X-10, and so on. 
The bridging device includes an IP network interface for 
receiving commands and requests from a UPnP controller on 
an IP network, and one or more slave network interfaces that 
transform the received commands and requests into device 
and network specific commands and requests. These device 
and network specific commands and requests are commu- 
nicated to the controlled device, via the slave network, using 
the slave network's protocol. The bridging device also 
communicates event status messages to the UPnP controller, 
corresponding to the non-UPnP devices 1 response to the 
UPnP controller's commands and requests. The bridging 
device also includes enabling logic to support the UPnP 
addressing, discovery, and description processes for each of 
the devices on the non-IP network. To minimize the storage 
requirements at the bridging device, the bridging device is 
configured to use a file server that is also resident on the IP 
network, wherein the file server contains the detailed infor- 
mation required to effect the appropriate UPnP addressing, 
discovery, and description processes, and other information- 
laden tasks, as required. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0010] The invention is explained in further detail, and by 
way of example, with reference to the accompanying draw- 
ings wherein: 

[0011] FIG. 1 illustrates an example block diagram of a 
system comprising a UPnP enabling device that bridges a 
UPnP control device to multiple non-UPnP devices in accor- 
dance with this invention. 

[0012] FIG. 2 illustrates an example block diagram of a 
UPnP enabling device for bridging a UPnP controller to 
non-IP networks, in accordance with this invention. 

[0013] FIG. 3 illustrates an example prior art UPnP pro- 
tocol stack. 

[0014] FIG. 4 illustrates an example prior art UPnP pro- 
cess. 

[0015] FIG. 5 illustrates a more detailed example block 
diagram of functions performed by a UPnP enabling device 
in accordance with this invention. 
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[0016] FIG. 6 illustrates an example flow diagram of 
thread creation to provide a non-blocking architecture for 
communications between the UPnP controllers and the non- 
UPnP devices, in accordance with this invention. 

[0017] Throughout the drawings, the same reference 
numerals indicate similar or corresponding features or func- 
tions. 

DETAILED DESCRIPTION OF THE 
INVENTION 

[0018] FIG. 1 illustrates an example block diagram of a 
system 100 comprising a UPnP enabling device 200 that 
bridges a UPnP controller, or UPnP User Control Point 
(UCP) 120 to multiple non-UPnP-compliant devices 150- 
180 in accordance with this invention. For ease of reference, 
UPnP-compliant objects are referred to as UPnP objects, and 
devices that are not UPnP-compliant are referred to as 
non-UPnP devices. These non-UPnP devices include, for 
example, devices on a USB network, a bluetooth network, a 
HAVi-compatible network, such as an IEEE 1394 network, 
a Home API network, a HomeRF network, a Firefly net- 
work, a power line network, such as an X-10 network, and 
a Jini-compatible network. 

[0019] The UPnP enabling device 200, in conjunction with 
a file server 130, provides the interface required to effect the 
control of the non-UPnP devices by the UPnP user control 
point 120, by emulating each of the non-UPnP devices as a 
UPnP-compliant device. In operation, the UPnP user control 
point 120 is a conventional UPnP controller that is config- 
ured to operate in conformance with the UPnP standards and 
protocols, issuing commands and requests to, and receiving 
status reports from, UPnP-compliant devices. In like man- 
ner, the non-UPnP devices 150-180 are conventional non- 
UPnP devices, such as USB-compliant devices 150, X-10- 
compliant devices 160, Bluetooth-compliant devices 170, 
and others 180, that are configured to receive commands 
from, and send status reports to, controllers that are specific 
to each of these non-UPnP standards and protocols. The 
UPnP enabling device 200 provides the bridging interface 
required to effectively emulate each non-UPnP device as a 
UPnP-controllable device for control by the UPnP user 
control point, and to emulate the UPnP user control point as 
a non-UPnP controller that conforms to each of the standards 
and protocols of the non-UPnP devices 150-180. 

[0020] Depending upon packaging and marketing require- 
ments, a UPnP enabling device 200 in accordance with this 
invention may include support for one or more non-UPnP 
interfaces. For example, a USB-specific enabling device 200 
may be marketed that includes the UPnP interface for 
communication with the UPnP user control point, and a USB 
port, or pair of USB ports, for communication with USB 
devices on a USB network. Alternatively, an embodiment of 
the UPnP enabling device 200 of this invention may include 
multiple interface options, such as a pair of USB ports, plus 
an RF transceiver for communicating with a device on a 
Bluetooth network. Also, although most controllable devices 
are configured to operate in a multiple-device network, the 
UPnP enabling device 200 may also be configured to pro- 
vide an interface for devices that operate via point-to-point 
control, such as an infrared interface to a printer or to a 
television receiver. The invention is presented herein using 
the paradigm of a UPnP enabling device for multiple- 



heterogeneous-networks, for illustrative purposes, although 
various alternative configurations will be obvious to one of 
ordinary skill in the art in view of this disclosure. 

[0021] FIG. 2 illustrates an example block diagram of a 
UPnP enabling device 200 for bridging a UPnP user control 
point 120 to non-IP networks 150', 170', 201, in accordance 
with this invention. Four example non-UPnP interfaces 
250«-4 commonly referred to hereinafter as slave network 
interfaces, are included in the example enabling device 200 
of FIG. 2. Any of a variety of techniques can be used to 
provide these interfaces 250a-rf. Illustrated in the interface 
250/?, for example, a PCI bus 253 is used as an intermediate 
bus between an internal bus 205 of the enabling device 200 
and a USB network 150'. In this manner, a conventional 
PCI-to-USB host controller 252 can be used to provide a 
USB-compliant interface to the USB network 150'. In this 
example interface 250b, a PCI bus bridge 251 transforms 
data on the internal bus 205 into PCI -compliant signals, and 
vice- versa, for communication via the PCI bus 253. Alter- 
natively, as illustrated by the slave interface 250c, a micro- 
controller 254 may be provided that transforms the data to 
and from the internal bus 205 from and to a USB host 
controller 255 directly. In like manner, a microcontroller 257 
is used in the slave interface 2S0d to communicate infor- 
mation to and from the internal bus 205, from and to a 
Bluetooth base station 258, for wireless communication with 
Bluetooth-compliant devices via an RF network 170'. Tech- 
niques for transforming data to and from an internal bus 205 
and an external network 150*, 170', 201, are common in the 
art. 

[0022] In a preferred embodiment of this invention, a 
processor 220 receives information from a UPnP user con- 
trol point (UCP) 120 via an IP network interface device 210 
and the internal bus 205. The interface device 210 includes 
Ethernet, xDSL, cable modem, wireless local loop, satellite, 
fiber to curb, or other IP network structure. The processor 
220 transforms the UPnP information from the UCP into 
network and device specific commands, and communicates 
these network and device specific commands, as required, 
via the internal bus 205, to the appropriate slave interface 
device 250a-d for communication to the particular non- 
UPnP device being controlled. In like manner, the processor 
receives information from each non-UPnP device, or from a 
network controller of the non-IP network, via the slave 
interface device 250*7-4 transforms the information into 
UPnP messages, as required, and communicates these UPnP 
messages to the UCP 120. Other embodiments will be 
evident to one of ordinary skill in the art. For example, in a 
USB-specific embodiment, the processor 220 may commu- 
nicate directly with the IP network interface 210 for com- 
municating UPnP messages, and directly with a USB host 
controller 255 for communicating USB messages, without 
the need for an intermediate bus structure 205. 

[0023] The specific functions performed by the processor 
220 to support UPnP messaging are discussed further below 
with regard to FIG. 5. FIGS. 3 and 4 are presented to 
provide a context for the understanding of the functions 
presented in FIG. 5. 

[0024] The UPnP Device Architecture defines the proto- 
cols for communication between UPnP user control points 
(UCPs) and devices. FIG. 3 illustrates the UPnP protocol 
stack 300 that is used for the discovery, description, control, 
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eventing, and presentation phases of UPnP network man- 
agement. At the highest layer 310, messages contain only 
UPnP vendor-specific information about their devices. Mov- 
ing down the stack, vendor content 310 is supplemented by 
information 320 defined by UPnP Forum working commit- 
tees. Messages from the layers 310, 320 above are hosted in 
UPnP-specific protocols 330, defined by the UPnP architec- 
ture. These protocols 330 are formatted using the Simple 
Service Discovery Protocol (SSDP), General Event Notifi- 
cation Architecture (GENA), and Simple Object Access 
Protocol (SOAP), and delivered via HTTP, at level 340. The 
HTTP 340 is either multicast 342 or unicast 344 running 
over UDP 352, or standard HTTP 346, 348 running over 
TCP 354. Each UDP 352 or TCP 354 message, at protocol 
level 350, is delivered via IP 360. 

[0025] FIG. 4 illustrates an example UPnP process for 
establishing and maintaining a network of UPnP user control 
points and controlled devices. The foundation for UPnP 
networking is IP addressing. Each device is assigned a 
unique address, at 410, either via an assignment by a 
Dynamic Host Configuration Protocol (DHCP) server that is 
managing the network, or via an Auto IP address generation 
function, if the network is not managed. Devices may also 
be assigned a device name, for ease of subsequent references 
to each device. 

[0026] Given an IP address, the next step in the UPnP 
process is discovery 420, wherein each device provides the 
network with a few essential specifics about the device or its 
services, with a pointer to more detailed information, as 
required. The UCPs may also use the discovery process to 
search for devices of particular interest. The devices adver- 
tise their essential characteristics when they first enter the 
network, as well as in response to a search for their char- 
acteristics by a UCP. To assure that the network is kept up 
to date, devices are required to periodically refresh their 
advertisement via the discovery process 420. Devices are 
logged off the network when they communicate a logoff 
message, or when they fail to refresh their advertisement. 

[0027] The next step in the UPnP process is description 
430, wherein UCPs that are interested in advertised devices 
issue a request for additional information from a URL 
(Universal Resource Locator) address that is contained in 
the device advertisement. Typically, this additional informa- 
tion regarding the device and its services is located at the 
device, but it may also be located at a remote location, such 
as an Internet site that is maintained by the vendor of the 
device. 

[0028] When a UPnP UCP learns of a device's capabili- 
ties, it is able to control and/or monitor the device, at 440, 
via an action request or a value query. In response to the 
action request, the device effects the action, and reports a 
result. Generally, the result is an acknowledgement that the 
requested action was effected, but it may be a more detailed 
message that reports the current device state, and/or the state 
of one or more variables associated with the device. In 
response to a value query, the device reports the state of one 
or more variables identified in the value query. 

[0029] The UCP may also request notification whenever 
an event occurs at the device, via the eventing process 450. 
The UCP 'subscribes' to be notified of any change of state 
at the device, and may exclude specified state changes, such 
as the change of value of particular variables, from this 



notification process. Whenever a device changes state, it 
notifies all subscribers of the event, except those subscribers 
that have excluded the specific state change from their 
subscription. 

[0030] The UCP presents the capabilities and controls 
associated with a device, based on a presentation page that 
is provided by the device, at 460. The UCP requests the 
presentation page from a URL that is provided in the device 
description. As with the device description at 430, the URL 
may address the device, or it may address a remote site, such 
as the vendor's Internet site, or a third-party service provid- 
er's site. 

[0031] FIG. 5 illustrates an example block diagram of a 
UPnP enabling device 200 comprising a UPnP interface 210, 
a UPnP proxy enabling processor 220 (220fl and 2206), and 
an interface 250 to a non-IP network in accordance with this 
invention. 

[0032] The UPnP (IP network) interface 210 includes an 
IP network module 501, and a network services layer 502 for 
accessing the IP network module 501, including creating and 
managing network communications, formatting appropriate 
IP messages, and receiving and sending messages. Consis- 
tent with conventional practice, the network services layer 

502 sends multicast UDP messages multiple times, to 
enhance reliability. 

[0033] The UPnP HTTP server 503 is a server process that 
supports the HyperText Transfer Protocol (HTTP) used for 
communication between the UPnP user control points 
(UCPs) 120 and the controlled devices (150-180 in FIG. 1), 
as discussed above with regard to the HTTP protocol layer 
340 of FIG. 3. In a preferred embodiment, the HTTP server 

503 handles interactions between multiple UCPs 120 and 
multiple devices, and is configured to provide a non-block- 
ing transfer. This non-blocking transfer is easily effected via 
the use of threads to handle different types of requests, as 
discussed further below. The functions provided by a HTTP 
server 503 in a preferred embodiment include: 

[0034] creating and managing threads to handle 
device connect and disconnect, and to handle UPnP 
defined queries for device capability, description, 
and presentation; 

[0035] creating and maintaining a network table 504 
that keeps track of each network and the type of 
threads created for the network, and records the 
communication data structures for each thread; 

[0036] monitoring a pre-defined TCP/IP server port 
and a pre-defined multicast UDP port to receive 
HTTP messages and to pass them to the correspond- 
ing modules that are responsible for the messages; 
and 

[0037] providing the Application Program Interface 
(API) for transforming responses and GENA notifi- 
cations into proper HTTP messages, and invokes 
network services 502 to send the messages. 

[0038] The UPnP HTTP server 503 uses the network table 

504 and the value of the HTTP request line, such as the 
HTTP requests GET, POST, M-POST, M-SEARCH, SUB- 
SCRIBE, and UNSUBSCRIBE for dispatching. For 
example, upon receipt of an HTTP M-SEARCH request, it 
dispatches messages to the discover server modules 510 
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corresponding to each network in the UPnP enabling device 
200, to effect the requested search. 

[0039] In a preferred embodiment of the UPnP enabling 
device 200, the processor 220 includes two parts for inter- 
facing with the UPnP interface 210. A first part 220a 
includes components that are embodied for each slave 
network or each device, and a second part 2206 includes 
components that are embodied for each service provided by 
each slave device in each slave network. For example, a 
VCR device typically provides a variety of services, includ- 
ing a clock service, a tuner service, and a tape transport 
service. 

[0040] The network-level processing block 220a includes 
the modules 510, 520, 530 required to effect and coordinate 
the UPnP discovery, presentation, and description phases, 
respectively, as well as a device manager module 540 that 
effects and coordinates commands and messages related to 
each device in the slave network. A device connect/discon- 
nect handler 550 provides information to the appropriate 
databases 515, 525, 535 that the modules 510, 520, 530 use 
to respond to UPnP requests regarding the presence of 
devices on the network, and their capabilities. In a preferred 
embodiment, the device connect/disconnect handler 550 
provides the following functions: 

[0041] determining the devices connected to the 
associated slave network; 

[0042] loading the code and data required for each 
connected device; and 

[0043] providing device-dependent data and code to 
the modules 510-530, via the databases 515-535. In 
general, the device -dependent data and code is pro- 
vided via access to a file server 130, discussed 
further below. 

[0044] When activated, the device connect/disconnect 
handler 550 uses the slave network interface 250 to deter- 
mine the identity of each device in its associated network. In 
accordance with one aspect of this invention, a file server 
130 is accessible via the IP network interface 210. This file 
server 130 is configured to contain the detailed information 
required to effect the UPnP notification, coordination, and 
control functions for each identified device, as well as the 
mapping between the advertised UPnP commands and the 
corresponding device and network specific commands. 
Depending upon the available memory (230 in FIG. 2) at the 
UPnP enabling device 200, the processor 220 fills in the 
discovery, presentation, and description information at the 
databases 515, 525, 535, respectively. Alternatively, the 
processor 220 merely stores the appropriate URLs of each 
device's presentation and description information, for sub- 
sequent communication to the UCP 120, as required, and as 
discussed above. These URLs may address information on 
the file server 130, or at other accessible locations, such as 
a vendor-supported, or third-party provided, Internet site. 

[0045] The device connect/disconnect handler 550 
accesses this information from the file server 130 via a 
device code and data loader 590 that is configured to form 
the appropriate IP-compatible requests, and to receive the 
corresponding IP responses. The particular functions that the 
device code and data loader 590 provide depend upon the 
distribution of information storage between the UPnP 



enabling device 200 and the file server 130, and includes 
some or all of the following functions: 



[0047] providing the interface to the device connect/ 
disconnect handler 550 to facilitate sending notifi- 
cations regarding the need to access the code or data 
associated with a particular device; 

[0048] forming the HTTP/GET message to fetch the 
required code or data for the device, via the UPnP 
HTTP server 503; 

[0049] receiving the results of the HTTP/GET mes- 
sage from the UPnP HTTP server 503; and 

[0050] returning the results to the device connect/ 
disconnect handler 550. 

[0051] If the UPnP enabling device 200 allows for 
dynamically loaded code to support the slave device or 
network interface, the code and data loader 590 also sepa- 
rates the code and data, communicates the data to the device 
connect/disconnect handler 550, processes the code, and 
stores it to a memory address assigned for dynamic linking. 
In a preferred embodiment, to conserve memory space (230 
in FIG. 2) at the device 200, the file server 130 contains the 
binary code for each process that is potentially required at 
the device 200. This code is preferably stored and commu- 
nicated as an attachment to an HTML page that is associated 
with the particular device and/or function. 

[0052] In a preferred embodiment, after creating and start- 
ing one device connect/disconnect handler 550 for each 
slave network, the HTTP server 231 is placed in a wait state 
during initialization until at least one of the handlers have 
finished adding the required information to the correspond- 
ing databases. After initialization, the handler 550 monitors 
each device for connection and disconnection, and updates 
each database 515, 525, 535 by appropriately adding or 
deleting device information. The handler 550 also forms one 
or more GENA notification messages, and invokes the API 
of the HTTP server 503 to multicast such additions and 
deletions. The handler 550 also periodically forms an SSDP 
'alive' message, and invokes the API of the HTTP server 503 
to broadcast the message, thereby refreshing each device's 
active status on the IP network. 

[0053] The discovery server module 510, and correspond- 
ing device capability database 515, implement the UPnP 
discovery server specification. As noted above, in a pre- 
ferred embodiment, the discovery module 510 is responsible 
for providing the UPnP discovery function for each device 
within its corresponding network. The functions of the 
discover module 510 in a preferred embodiment include: 

[0054] providing an API for querying the network or 
devices for device characteristics; 

[0055] processing UPnP search messages, such as an 
M-SEARCH message with an "ssdp discover" mes- 
sage header; and 

[0056] upon receipt of an SSDP query, searching the 
device capability database 515, forming a response, 
and invoking the aforementioned HTTP server 503 
API to return the response to the requester. 



[0046] constructing the local path of the URL, asso- 
ciated with each device's code and data, based on the 
IP address or host name of the file server 130; 
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[0057] The device capability database 515 contains data 
structures in memory that store information about the capa- 
bilities of each device known to the module 510, and is 
preferably organized for efficient operations for SSDP 
searches. 

[0058] The description server module 530 implements the 
UPnP description server specification, discussed above. The 
module 530 either provides the appropriate URL for locating 
the device description and/or the presentation, or it provides 
the device description and/or the presentation, directly or via 
the file server 130, for devices that do not have a corre- 
sponding remote URL address at which the description 
and/or the presentation is located. Initially, it will be 
expected that devices on a non-IP network will not have an 
associated UPnP description at a remote URL address, and 
thus the UPnP enabling device 200 will need to provide the 
description, via a device description database 535, or via 
access to the file server 130. As this invention becomes 
commonplace, however, vendors or third party developers 
are likely to develop UPnP descriptions for non-UPnP 
devices, and the amount of information required to be stored 
at the device description database 535, or at the file server 
130 will, correspondingly, be substantially reduced. The 
functions of the description server module 530 include: 

[0059] providing an API for querying device descrip- 
tions; 

[0060] processes HTTP/GET messages addressed to 
the local description server that is responsible for 
presenting the description for the devices on the 
slave network under its responsibility; and 

[0061] searching the device description database 535 
in response to HTTP/GET messages, and invoking 
the API at the HTTP server 503 to return the 
response. 

[0062] The presentation module 520 implements the UPnP 
presentation server specification, and is configured similar to 
the description server module 530 to respond to HTTP/GET 
messages addressed to the local presentation server respon- 
sible for the devices on the network, using the device 
presentation database 525, or the file server 130 as required. 

[0063] In a preferred embodiment, the device manager 
module 540 enables multiple UCPs 120 to simultaneously 
control multiple devices in the slave network under its 
responsibility, in response to device access and control 
requests, such as HTTP POST and M-POST messages. The 
functions of the device manager module include: 

[0064] creating and managing threads to route and 
handle device control requests, as discussed below; 
and 

[0065] providing an interface for the device connect/ 
disconnect handler to provide notification of device 
connect and disconnect events. 

[0066] The device table 545 stores the mapping between a 
service identification (for example, a device UUID and a 
service name) and the data structures used to communicate 
data with the service control server 570 and the event 
subscription server 560. 

[0067] The service-level UPnP block 2206 includes an 
event subscription server module 560, a service control 



server module 570, and an event source module 580. Typi- 
cally, a device provides one or more services. Preferably, 
there is one event subscription server module 560, one 
service control server module 570, and one event source 
module 580 associated with each service provided by a 
device. Correspondingly, there is one event subscription 
database 565 and one service state table 585 associated with 
each service. 

[0068] The service control server module 570 is respon- 
sible for effecting control commands directed to its associ- 
ated service. The functions of the service control server 
module 570 in a preferred embodiment includes: 

[0069] parsing SOAP commands, invoking the 
appropriate driver interface(s) to effect each com- 
mand, and invoking the API at the HTTP server 503 
to send an acknowledgement or failure message to 
the requester; 

[0070] updating the service state table 585 upon 
successful command execution, if the state of the 
service changes; 

[0071] monitoring events posted by the slave device, 
and updating the service state table 585 if the state of 
the service changes; and 

[0072] invoking the event source module 580 with 
each update of the service state table 585. 

[0073] In a preferred embodiment, because not all slave 
device drivers are configured to report the entire state of the 
driven device, the service state table 585 is used to record the 
current value of the state of each service (power, register 
values, and so on). The table 585 is initialized when the 
device enters the UPnP control network and is kept consis- 
tent with the state of the service(s) provided by the device by 
updating the state every time a state-changing command is 
successfully executed. 

[0074] The event subscription server module 560 is 
responsible for allowing UCPs to express their interest about 
device events related to each service. The functions of the 
event subscription server module 570 in a preferred embodi- 
ment includes: 

[0075] parsing GENA event subscription messages, 
entering the subscribing UCP's identification and 
subscribed events in the event subscription database 
565, or at the file server 130, and invoking the API 
of the HTTP server 503 to send an acknowledgement 
(or failure notification) to the subscriber UPnP con- 
troller; and 

[0076] invoking the event source module 580 to pass 
the current state of the service to a first-time sub- 
scriber UCP. 

[0077] The event source module 580 is responsible for 
posting events of the service to all UCPs that have sub- 
scribed to such events. The functions of the event source 
module 580 in a preferred embodiment includes: 

[0078] providing an interface for the service control 
module 570 to pass notifications about the changes in 
the service status to the service state table 585; 

[0079] examining the event subscription database 
565, or the corresponding data on the file server 130, 



US 2002/0078161 Al 



6 



Jun. 20, 2002 



notifying subscriber UCPs of subscribed event 
changes by forming a GENA notification message, 
and invoking the API of the HTTP server 503 to send 
the GENA message; and 

[0080] providing an interface for the event subscrip- 
tion server module 560 to effect the notification of 
each first-time subscriber of the state of the service, 
via the formation and transmission of a GENA 
notification message, via the API of the HTTP server 
503. 

[0081] FIG. 6 illustrates an example flow diagram of 
thread creation to provide a non-blocking architecture for 
communications between the UCPs and the slave devices, in 
accordance with this invention. For convenience and ease of 
understanding, the foregoing description provides refer- 
ences to items in the previous figures, although the prin- 
ciples presented in this flow diagram are also applicable to 
other structures or system configurations. The first digit of 
each reference numeral corresponds to the first figure at 
which the referenced item is introduced. 

[0082] At 610, the HTTP server 503 allocates and initial- 
izes memory spaces for the network table 504, the device 
capability database 515, the device description database 535, 
and the device presentation database 525, for each slave 
network. As noted above, this initialization information may 
include references to information that is stored at the file 
server 130, or at remote URLs. The HTTP server 503 also 
allocates and initializes a space for communication and 
synchronization between itself and each of the slave net- 
work's device connect/disconnect handler 550. At 615, the 
HTTP server 503 creates a device connect/disconnect han- 
dler thread for each network, and waits until at least one of 
the device connect/disconnect handlers 550 reports that it 
has successfully initialized the device capability database 
515, the device description database 535, and the device 
presentation database 525. When the HTTP server 503 
receives the notification that the device connect/disconnect 
handler 550 has initialized the databases 515, 525, 535, the 
HTTP server 503 allocates and initializes a data structure for 
each working thread that it will create, at 620. These data 
structures are used to communicate with the threads. The 
HTTP server 503 repeats the process 615-620 for each 
network, as each network's device connect/disconnect han- 
dler 550 reports a successful initialization of the network's 
databases 515, 525, 535. At 630, the HTTP server 503 
creates working threads, one for handling device discovery, 
one for handling device description, and one for handling 
device presentation. Each thread activates the corresponding 
modules and receives a pointer to the database 515, 535, and 
525, respectively, that it will use. At 635, the HTTP server 
503 records each network type, each thread type, and the 
communication data structure for each thread, into the 
network table 504. Thereafter, the HTTP server 503 directs 
each device manager 540 to set up service handling threads 
for each device in the network for which the manager 540 is 
responsible. The manager 540 executes in the context of the 
HTTP server 231. 

[0083] At 650, each device manager 540 first queries the 
discovery service module 510 to obtain a list of devices in 
the network for which it is responsible. For each device, the 
manager further queries the description server module to get 
a list of services provided by the device. The manager 540 



then creates a service-handling thread for each service 
provided by each device, and a corresponding data structure 
for communicating with each thread. At 655, the device 
manager 540 records the mapping of each thread to each 
service provided by the device in the device table 545. 

[0084] At 670, each service -handler thread allocates and 
initializes the event subscription database 565 and the ser- 
vice state table 585 for its associated service. At 675, each 
service-handler thread activates each of the service control 
570, event subscription 560, and event source 580 modules 
associated with the service. 

[0085] Not illustrated, when a device is added to the 
network, the device manager 540 creates and records a 
service-handler thread for each service provided by the 
device, as in blocks 650-655. The newly created service- 
handler thread creates and initializes the service-specific 
database 565 and table 585, and activates the modules 560, 
570, 580, as in blocks 670-675, above. 

[0086] At 690, all threads created in blocks 630 and 650 
wait until being notified of pending work, via the data 
structure associated with each thread. When the HTTP 
server 503 identifies an incoming request for a particular 
working thread, the server 503 places the request into the 
data structure corresponding to the thread, then returns to 
handle the next request. In this manner, the HTTP server 503 
devotes substantially little time to the processing of request; 
the actual processing of each request is effected via a single 
placement of the request into an appropriate data structure. 
In a preferred embodiment, each thread periodically checks 
the contents of its data structure. When one or more items of 
the data structure change, the thread determines the appro- 
priate action to take in response to the change, and reacts 
accordingly. After the work is completed, the thread invokes 
the API at the HTTP server 503 to communicate an acknowl- 
edgement (or a failure notice if the request was not fulfilled) 
to the UCP that issued the incoming request. In the case of 
an incoming control command, the command is placed in 
communication data structure of the service-handling thread 
of the targeted service. When the service-handling thread 
detects this command in its data structure, it determines the 
type of command. If the command is an event subscription, 
it passes the command to the event description server 
module 560. If the command is a service control command, 
the command is passed to the service control server module 
570. 

[0087] Alternative thread initiation and control schemes 
will be readily apparent to one of ordinary skill in the art. For 
example, a thread can be created when a request for a 
particular service arrives for the first time. In this scheme, 
for example, the device manager 540 provides an interface 
for the device description server module 530 to pass a 
notification when a description is requested by a UCP. Upon 
receiving the notification, the device manager 540 checks 
the device table 545 to determine if the service-handling 
thread already exists for the device; if not, a thread is created 
for each service provided by the device. In this manner, 
service-handling threads are only created for devices for 
which at least one UCP has expressed interest. Alternatively, 
although threads may be expected to provide an efficient 
implementation, processes can be used to implement the 
enabling logic in lieu of threads. Such processes will com- 
municate either via shared memory, as in the case of threads, 
or via message passing. 
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[0088] As presented above, an embodiment of this inven- 
tion provides a means for facilitating the control of non- 
UPnP devices via a UCP. As will be evident to one of 
ordinary art, if, as in the examples provided, shared memory 
is used for communication and synchronization, proper 
locking mechanisms, common in the art, should be used to 
ensure proper operation. It is important, for example, for the 
device capability database 515, the device description data- 
base 535, the device presentation database 525, and the 
device table 545 to be consistent, and therefore atomic 
operations for updating each database should be enforced. 
For example, write operations to a database or table will 
typically take priority over read operations, to assure that the 
read operation is provided the freshest data. These and other 
means of maintaining data consistency are common in the 
art. 

[0089] In a preferred embodiment of this invention, the 
use of a consistent naming convention scheme is used to 
simplify the design. For example, the local part of the URL 
that is used for each server has the prefix: networkjype/ 
server_type, such as "usb/descriptionServer", or "bluetooth/ 
presentationServer", and so on. To facilitate locating of 
device files at the file server 130 by the device connect/ 
disconnect handler 550, each file name contains an identifier 
of the device, and the contents of the file, such as "USB 
interface. code", "laser_printer. description", or "scanner. ca- 
pability". These names may be made more specific by 
including, for example, an indication of the make or model 
of the device. If device functions are provided via library 
functions, the function names contain a prefix that uniquely 
identifies the device, thereby avoiding function names con- 
flicts. 

[0090] The foregoing merely illustrates the principles of 
the invention. It will thus be appreciated that those skilled in 
the art will be able to devise various arrangements which, 
although not explicitly described or shown herein, embody 
the principles of the invention and are thus within its spirit 
and scope. For example, the particular functional partition- 
ing presented in the figures is presented for illustrative 
purposes, and various combinations of hardware and soft- 
ware implementations may be used to embody the invention. 
These and other system configuration and optimization 
features will be evident to one of ordinary skill in the art in 
view of this disclosure, and are included within the scope of 
the following claims. 



I claim: 

1. A UPnP interface device that is configured to facilitate 
UPnP control of at least one non-UPnP device that are 
located on one or more slave networks using one or more 
different network technologies, comprising: 

an IP interface to at least one UPnP controller, the UPnP 
controller being configured to issue a UPnP command 
in conformance with a UPnP protocol, 

at least one non-IP interface to the at least one non-UPnP 
device, and 

a processor that is configured to: 

receive the UPnP command, via the IP interface, 

transform the UPnP command into a device command, 



communicate the device command to a target device of 
the at least one non-UPnP device via the at least one 
non-IP interface, and 

communicate a UPnP acknowledgement of the UPnP 
command to the at least one UPnP controller, via the 
IP interface, and 

2. The device of claim 1, wherein the one or more network 
technologies include at least one of: a USB network, a 
bluetooth network, a HAVl-compatible network, an IEEE 
1394 network, a Home API network, a HomeRF network, a 
Firefly network, a power line network, an X-10 network, and 
a Jini-compatible network. 

3. The device of claim 1, wherein: 

the UPnP controller is further configured to issue a UPnP 
request in conformance with the UPnP protocol, 

the UPnP request includes one of: a description request, a 
presentation request, a subscription request, and a 
query, and 

the processor is configured to provide at least one of: a 
device description, a service description, a presentation 
page, an event, and a value of a variable, in response to 
the UPnP request. 

4. The device of claim 3, wherein 

the IP interface also provides access to a file server, and 

the processor provides the at least one of: the device 
description, a service description, a presentation page, 
an event, and a value of a variable, based on informa- 
tion received from the file server. 

5. The device of claim 1, wherein 

the processor includes at least one of: 

a discovery module that is configured to provide an 
advertisement of the at least one non-UPnP device to 
the UPnP controller, 

a description module that is configured to provide a 
description of functions of the at least one non-UPnP 
device to the UPnP controller, in response to a 
request from the UPnP controller, and 

a presentation module that is configured to provide a 
presentation page that facilitates a control of the at 
least one non-UPnP device by a user. 

6. The device of claim 5, wherein 

at least one of the discovery module, the description 
module, and the presentation module is configured to 
provide the advertisement, the description, and the 
presentation page, respectively, for the at least one 
non-UPnP device of the slave networks, 

7. The device of claim 1, wherein 

the processor includes at least one of: 

a service control module that communicates commands 
to the target device, 

an event subscription module that receives requests 
from the at least one UPnP controller to be notified 
of one or more changes of state of the target device, 
and 

an event source module that notifies the at least one 
UPnP controller of one or more changes of state of 
the target device. 



US 2002/0078161 Al 



8 



Jun. 20, 2002 



8. The device of claim 7, wherein 

the service control module maintains a service state table 
that reflects the state of the target device, and 

the event source module notifies the at least one UPnP 
controller of the one or more changes of the state of the 
target device based on the service state table. 

9. The device of claim 1, wherein the UPnP server enabler 
communicates the device command to the target command 
by modifying a data structure that is associated with a 
thread, and the thread effects the communication to the at 
least one non-UPnP device of the slave networks. 

10. The device of claim 1, wherein 

the IP interface also provides access to a file server, and 

the processor effects the transform of the UPnP command 
into the device commands based on information 
received from the file server. 

11. The device of claim 1, wherein 

the processor is further configured to recognize a connec- 
tion and disconnection of the at least one non-UPnP 
device, and initiates and terminates threads in response 
to each connection and disconnection, respectively. 

12. A method for facilitating UPnP control of at least one 
non-UPnP device on a slave network, comprising: 

receiving device-dependent data corresponding to each of 
the at least one non-UPnP device from a file server, 

receiving a UPnP command in conformance with a UPnP 
protocol from a UPnP controller, 

transforming the UPnP command into a device command, 
based on the device-dependent data received from the 
file server, 

communicating the device command to a target device of 
the at least one non-UPnP device on the slave network, 
and 

communicating a UPnP acknowledgement of the UPnP 
command to the UPnP controller. 

13. The method of claim 12, wherein the slave network is 
one of; a USB network, a bluetooth network, a HAVi- 
compatible network, an IEEE 1394 network, a Home API 
network, a HomeRF network, a Firefly network, a power 
line network, an X-10 network, and a Jini-compatible net- 
work. 

14. The method of claim 12, further including: 

receiving a UPnP request in conformance with the UPnP 
protocol, 

the UPnP request including one of: a description 
request, a presentation request, a subscription 
request, and a query, and 

providing at least one of: a device description, a service 
description, a presentation page, an event, and a value 
of a variable, in response to the UPnP request, based on 
information received from the file server. 

15. The method of claim 12, further including at least one 

of: 

providing an advertisement of at least one non-UPnP 
device to the UPnP controller, 



providing a description of functions of the at least one 
non-UPnP device to the UPnP controller, in response to 
a request from the UPnP controller, and 

providing a presentation page that facilitates a control of 
the at least one non-UPnP device by a user. 

16. The method of claim 15, wherein 

at least one of the advertisement, the description, and the 
presentation page are provided by the file server. 

17. The method of claim 12, further including 

receiving requests from the UPnP controller to be notified 
of one or more changes of state of the at least one 
non-UPnP device, and 

notifying the UPnP controller of one or more changes of 
state of the at least one non-UPnP device. 

18. The method of claim 17, further including 

maintaining a service state table that reflects the state of 
the target device, and 

notifying the UPnP controller of the one or more changes 
of the state of the at least one non-UPnP device based 
on the service state table. 

19. The method of claim 12, further including 

creating a thread that is associated with the at least one 
non-UPnP device of the slave network, and 

modifying a data structure that is associated with the 
thread; and 

wherein the thread is configured to effect the communi- 
cation of the device command to the at least one 
non-UPnP device of the slave network, based on the 
modification of the data structure. 

20. A network comprising: 

an IP sub-network, 

a non-IP sub-network, and 

a UPnP enabling device that facilitates control of a device 
on the non-IP sub-network by a UPnP controller on the 
IP sub-network. 

21. The network of claim 20, further including 

a file server on the IP sub-network, and 
wherein 

the UPnP enabling device facilitates the control of the 
device based on information received from the file 
server. 

22. The network of claim 20, wherein 

the UPnP enabling device is configured to: 

receive a UPnP command from the UPnP controller on 
the IP network, 

transform the UPnP command into a device command, 
and 

communicating the device command to the device on 
the non-IP sub-network. 

23. The network of claim 22, wherein 

the UPnP enabling device is further configured to provide 
at least one of: a device description, a service descrip- 
tion, a presentation page, an event, and a value of a 
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variable corresponding to the device on the non-IP 
network, in response to a UPnP request from the UPnP 
controller. 

24. The network of claim 23, further including 
a file server on the IP sub-network, and 
wherein 

the UPnP enabling device provides the at least one of: the 
device description, the service description, the presen- 



tation page, the event, and the value of the variable, 
based on information received from the file server. 
25. The network of claim 20, wherein 

the UPnP enabling device facilitates the control of the 
device on the non-IP sub -network by a UPnP controller 
on the IP sub-network via the use of threads that 
provide a non-blocking communication. 

***** 
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ABSTRACT 



A hearing evaluation and hearing aid fitting system provides 
a fully immersive three-dimensional acoustic environment 
to evaluate unaided, simulated aided, and aided hearing 
function of an individual. Digital filtering of one or more 
signal sources representing speech and other audiologically 
significant stimuli according to selected models and digitally 
controlled signal processing parameters, including audio 
sources, spatializing coordinates, acoustic boundaries, sig- 
nals representing one or more simulated hearing aids, and 
individualized body/external ear transfer functions synthe- 
sizes a simulated acoustic condition for presentation to a 
hearing- impaired person for objective and subjective hear- 
ing evaluation via an intra-canal prosthesis that is positioned 
in the ear canal, and that incorporates a microphone probe to 
measure in-the-ear-canal responses at a common reference 
point near the tympanic membrane during unaided, simu- 
lated aided, and aided hearing evaluation, thus providing 
measurements that are directly correlated across all phases 
of hearing assessment during the fitting process of a hearing 
aid. 
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Variability of measured SPL versus distance of probe tip from 
tympanic membrane for 5 khz and 1 5 kHz tones for an individual. 
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Measured SPL for 5 kHz and 15 kHz during probe advancing at j 
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SPATIALIZATION FOR HEARING individual's hearing function is important because all hear- 

EVALUATION m g aid prescriptive formulas depend on one or more sets of 

hearing diagnostic data (see Mueller, H. G., Hawkins, D. B., 

This is a divisional of copending application Ser. No, Northern, J. L., Probe Microphone Measurements: Hearing 

08/292 073 filed on Aue 17 1994 5 Aid Selection and Assessment, Singular Publishing Group, 

B ' 9 ' Inc., 1992: Ch, 5). 

BACKGROUND OF THE INVENTION The hearing aid prescription process involves translating 

the diagnostic data into target hearing aid electroacoustic 

1. Technical Field parameters that are used in the selection of the hearing aid. 
The present invention relates to hearing evaluation and 10 Traditional hearing evaluation methods and instruments 

hearing aid fitting. More particularly, the present invention employ a variety of air-conduction transducers for coupling 

relates to virtual electroacoustic audiometry for unaided, acoustic signals into the ear. Commonly used transducers 

simulated aided, and aided hearing evaluation. include supra-aural earphones, such as TDH-39, TDH-49, 

2. Description of the Prior Art TDH-50, insert earphones, such as ER-3A, and free-field 
The human auditory system processes sounds from a 15 speakers (see Specification of Audiometers, ANSI-S3.6- 

complex three-dimensional space via the external, middle, 1989, American Standards National Institute), 

and inner ear, as well as via the complex neural pathways A threshold measurement obtained with such transducers 

that lead to the auditory cortex within the brain. A measur- is referenced to a mean threshold obtained by testing a group 

able hearing loss, due to various conductive, sensorineural, of otologically normal individuals. This mean threshold, by 

or central auditory disorders, affects a significant percentage 2Q definition, is referred to as the zero decibel hearing-level or 

of the human population, particularly elderly persons. Reha- 0 dB HL. With this zero reference concept, threshold mea- 

bilitation via hearing aids remains the only viable option for surements of otologically normal persons can vary by 20 dB 

those types of hearing impairments that cannot otherwise be or more> These variations can be attributed to following 

medically treated or surgically alleviated. factors: 

Advances in hearing aids and fitting technologies are 25 i. Variability due to transducer type used and placement 

continuously being made. Today's ear-level hearing aids, i.e. w j t ^ reS p ec t to the ear. 

in-the-ear (ITE), behind-the-ear (BTE), in-the-canal (ITC), In a study by Mowrer, et al discrepancies of 10 dB were 

and completely-in-the-canal (CIC) types, are more cosmeti- found in 36% of threshold measurements (see Mowrer, D. 

cally appealing due to improvements in electronic and g Stear c ^^hold measurement variability among 

mechanical miniaturization. More significant, however, is ^ ^ dis Heari Instrumentj vol . 43, No< 4> 

the increasing availability of advanced hearing aid signal JU mno\ a *u ■ a- a ♦ e ™ * 

processing schemes, such as adaptive filtering and multi- l992 > ^ n0{hc \ m fJ or disadvantage of measurements 

band dynamic compression. obtamed usin ^ a traditional transducer is that results are not 

, . , , , . , interchangeable with measurements taken with another 

As manufacturers are continuously developing new hear- transducer for a ^ ven individua i (see G authier, E. A., 

mg aids with unique signal processing schemes, a hearing „ . , . ~ A 7 , , . ^ v 7 , , . ™ , , , 

» j j . . ^ r . to . K - j *u • • 1 v» Rapisadn, D. A., A Threshold is a Threshold is a threshold 

aid dispensing professional is faced with the increasingly r . ' TT . , , 4 , - 

difficult task of prescribing and selecting a hearing aid for a '< ' or ls lt? > Heann S Instruments, vol. 43, no. 3, 1992). 

hearing-impaired individual from the available selection. A 2 - Variability due to transducer calibration methods that 

cursory look at available hearing aid processing schemes employ couplers that do not represent the human ear. 

reveals an impressive array of categories, sub-categories, Although recently developed couplers more closely 

and associated acronyms that are baffling to most hearing aid 40 match the acoustic impedance characteristics of an average 

dispensing professionals (see Mueller, H. G., A Practical human ear, there is still disagreement as to the accuracy of 

Guide To Today's Bonanza of Underused High-Tech Hear- this artificial ear (see Katz, J., Handbook of Clinical 

ing Products, The Hearing Journal, vol. 46, no. 3, pp. 13-27, Audiology, Third Edition, 1985, pp. 126). Most calibration 

1993). methods today rely on 6-cc or 2-cc couplers that are known 

Today, optimal fitting of prescription hearing aids remains 45 to have considerable acoustic characteristic discrepancies 

an elusive goal in auditory rehabilitation. The fundamental from real human ears (see Specification of Audiometers, 

problem is that there are numerous electrical, acoustic, ANSI-S3. 6-1989, American Standards National Institute), 

physical, and other parameters that affect hearing aid per- Furthermore, even if an agreement was made regarding an 

formance. These parameters include signal processing average artificial ear, variability among individuals is sig- 

schemes, electronic circuit adjustments, size of hearing aid, 50 nificant due to individual acoustic characteristics of pinna, 

insertion depth, venting size, patient controls, and life-style ear cmSi \ y concha, and to a lesser extent, the head, and the 

related factors that must be considered when prescribing and torso ( see Mueller, h. G., Hawkins, D. B., Northern, J. L., 

fitting a hearing aid. These hearing aid parameters are not Pwbe Microphone Measurements: Hearing Aid Selection 

only complex and highly interrelated, but also vary accord- and Assessment 1992j pp . 49-50). In one study, inter- 

mg to the unique j^™*ion of the hearing device with the js sub j ect variability was up t0 38 dB across six standard 

P ' audiometric frequencies when sound pressure levels (SPL) 

Generally, the in situ performance characteristics of a were measured at the t y mpan ic membrane for 50 ears of 25 

hearing aid cannot be predicted with today's conventional adults (gee Valente? M Potts> L Valente) M Vass? B 

fitting instrumentation and methods. Dissatisfaction among Intersubject Variability of Real-Ear SPL:TDH-39P vs 
hearing aid user s, partially due to poor hearing aid pre- 

scnption fitting, is manifested by a high return rates, often ^ „ y . \ K, . J , , . 

exceeding 20% according to industry reports. 3 - Conventional audiometnc measurement methods do 

not provide a means of self-calibration even though 

Factors that Contribute to Unsatisfactory Hearing transducer characteristics are known for changes due to 

Aid Results wear or damage of the moving diaphragm. 

I. Inaccuracy of conventional diagnostic audiometry. 65 Clinicians who use regular subjective listening methods 

Assessment of hearing is the first step in the prescribing simply cannot detect gradual changes in transducer sensi- 

and fitting of a hearing aid. Accurate assessment of the tivity. 
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Although errors due to the above factors are not likely to Today's methods of presenting competing and environ- 
be accumulative in all cases, the potential for substantial mental sounds via conventional transducers fail to represent 
errors is always present. Furthermore, these errors are not the acoustic reality of the typical listening condition, 
consistent across all frequencies and therefore cannot be Recorded sound material presented via tape players, corn- 
simply compensated for during the fitting process via an 5 pact disks, or computer digital playback are subject to 
overall volume adjustment. filtering effects of the transducer employed and/or the room 
II. Lack of realistic listening conditions in the unaided and acoustics of the clinical setup. There are no hearing assess- 
aided hearing assessment. ment methods today that can evaluate or predict the hearing 

1. Lack of Binaural Advantage Considerations. performance of an individual in a specific and realistic 
Many studies have demonstrated the advantage of binau- 1Q listening scenario. 

ral versus monaural listening (see Cherry, E. C, Some For example, the hearing performance of a hearing- 

Experiments on the Recognition of Speech with One and Two impaired child in a typical classroom in the unaided 

Ears, JASA, vol. 25, no. 5, 1953, pp. 975-979; Cherry, E, condition, and the hearing performance of the child with a 

C, and Tylor, W, K., Some Further Experiments on the specific hearing aid, i.e. aided hearing, in the same class- 

Recognition of Speech with One and Two Ears, JASA, vol. room environment. These and other auditory experiences are 

26, 1954, pp. 549-554) These studies have focused on the presently consi dered a fact of life that can not be dealt with 

advantages offered by the Binaural Masking Level Differ- fa a (gee MueU R Q Hawkins, D. B., 

fBILD? Intelligibility Level Difference North ^ j ^ Micwphone Measurements: Hearing 

Early studies of BMLD and BILD involved the presen- S *! ect >° n ^Assessment, 1992, pp. 69). 

* • i a • + _ _ i ni u . + „u^ a on III. Limitations of current real-ear measurement (REM) 

tation ot signal and noise to one or both ears at various phase 20 v ' 

relationships. Tone detection and speech intelligibility were equipment and methods. 

shown to vary as much as 15 dB, depending on the signal/ In recent y ears > real ear measurement (REM) systems 

noise phase relationship. Even though many of these studies were developed to assess the in situ performance of a 

suggest the significance of binaural considerations, today's hearing aid. REM consists of test probe measurements of the 

hearing assessment methods, unaided and aided, primarily 2 5 ear re sponse to free field stimulus, i.e. speakers, taken at the 

deal with monaural test conditions, i.e. testing one ear at a tympanic membrane. A secondary reference microphone is 

time. typically placed outside the ear canal close to the ear canal 

2. Lack of Spatialized Sound Considerations. opening. The reference microphone is used to calibrate the 
When audiometric signals such as speech and/or noise are test probe as well as to regulate the stimulus level as the head 

delivered to the ear via a conventional audiometers and 30 moves with respect to the free field speaker, 

associated transducers, the sound perception by the test For a comprehensive REM evaluation, measurement of 

subject is not localized to any particular point in space (see the real ear response for the unaided, i.e. open canal, 

Specification of Audiometers, ANSI-S3. 6-1989, American condition is first taken. Target hearing aid characteristics are 

Standards National Institute). For example, in speech audi- then calculated based on the natural ear canal response 

ometry evaluation, the speech stimuli level is adjusted for characteristics, as well as other criteria (see Mueller, H. G., 

one ear and speech noise level is separately adjusted in the Hawkins, D. B., Northern, J. L., Probe Microphone Mea- 

opposite ear. The test subject perceives sounds to be within surements: Hearing Aid Selection and Assessment, 1992, 

the head and localization is limited to left/right direction. Ch 5) When ±G ^ aid ig ribed ordered and 

This type of signal presentation and perception is referred to receiv ' ed durf a sub nt visit the aid is inserted over 

as intracranial and is unlike the way humans normally tU , . , to , \ , 4 \ , , . 

perceive natural sounds. Recent studies by Bronkhorst and 40 the P™be tube and adjusted to match the prescribed target 

Plomp, and Begault expanded on previous binaural interac- „"° g , ,? J 0 ?,™ , , 

tion advantage studies by employing headphone localization evaluation and REM-based prescriptive methods 

techniques (see Bronkhorst, A. W., Plomp, R., The Effects of P r0Vlde considerable improvements over previous fitting 

Head-Induced Interaural Time and Level Differences on methods which relied on the combination of audiometric 

Speech Intelligibility in Noise, Journal of the Acoustical 45 data and hearing aid 2-cc coupler specifications. Although 

Society of America, vol. 83, no. 4, 1988, pp. 1508-1516; REM on °ers insight into the in situ performance of the 

Bronkhorst, A. W.; Plomp, R., The Effects of Multiple hearing aid, it suffers from several fundamental problems, as 

Speech-like Maskers on Binaural Speech Recognition in described below: 

Normal and Impaired Hearing, Journal of the Acoustical 1. REM test results vary considerably depending on 

Society of America, vol. vol. 92, no. 6, 1992, pp. 50 speaker position/orientation with respect to the ear, 

3132-3139; and Bagault, D. R., Call Sign Intelligibility particularly at higher frequencies (see Mueller, H. G., 

Improvement Using a Spatial Auditory Display, Ames Hawkins, D. B., Northern, J. L., Probe Microphone 

Research Center, NASA Technical Memorandum 104014, Measurements: Hearing Aid Selection and Assessment, 

April 1993). The results of these studies conclude the speech 1992, pp. 72-74). 

perception is not only dependent on intensity levels but also 55 2. Real ear measurements are taken with a specific stimu- 

on the spatial relationship between speech and noise. lus type, source-ear distance/orientation, and room 

3. Lack of Evaluation Methods in Realistic Listening acoustics. The specific test condition may not represent 
Environments. realistic listening scenarios encountered by hearing aid 

Speech intelligibility and discrimination deteriorates in users. In fact, using conventional REM approaches, a 

the presence of competing speech and other environmental 60 hearing aid may be optimized for a specific listening 

sounds. Furthermore, the acoustic properties of a room, e.g. condition while compromising the performance under 

its walls and objects within the room, all play an important other conditions that may be more important to the 

role in the filtering process subjected to the original signal hearing-impaired individual. 

source. These filtering effects are especially significant for 3. Accurate REMs require careful placement of the test 

hearing-impaired individuals who typically have a limited 65 probe within the ear canal of an individual. The closer 

frequency response and dynamic range in their hearing the probe to the tympanic membrane, the more accurate 

function. the results are, particularly for high frequency mea- 
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surements (see Mueller, H. G., Hawkins, D. B., individuals who cannot be medically or otherwise treated. A 
Northern, J. L., Probe Microphone Measurements: full audiometric evaluation is a required first step prior to 
Hearing Aid Selection and Assessment, 1992, pp. fitting a hearing aid. Pure tones and one or more speech 
74-79). perception tests are typically involved in the basic audio- 
Present methods of probe placement are highly dependent 5 metric test battery. Suprathreshold measurements may also 
on the operating clinician's skill and the specific length of be taken to establish a hearing dynamic range profile, in 
the canal, which is about 25 mm for the average adult. addition to the frequency response profile obtained in the 
Today's REM methods rely on visual observation of the threshold audiogram test. Following the audiometric 
probe tip. evaluation, a hearing aid is then prescribed, selected, 
This is especially problematic when a hearing aid is 10 ordered, and subsequently tried and adjusted after being 
placed in the canal during the aided evaluation process. The received from the manufacturer or assembled in the clinic, 
only exception to the conventional visual method is the The fitting or determination of the electroacoustic param- 
acoustic response method developed by Nicolet Corp. for eters 0 f a hearing aid typically involve a combination of 
use in the Aurora system (see Chan, J., Geisler, C, Estima- objective measurements to achieve a desired target charac- 
tion of Eardrum Acoustic Pressure and Ear Canal Length 15 teristics based on one of many prescriptive formulae and 
from Remote Points in the Canal, J . Acoust. Soc. Am. 87 (3), subjective measures based on the individual's subjective 
March 1990, pp. 1237-1247; and U.S. Pat. No. 4,809,708, response to speech and other sounds at various loudness 
Method and Apparatus for Real Ear Measurements, March levels. 

1989). However, Nicolet's acoustic response method Conventional audiometry methods, employing 

requires two calibration measurements prior to placement of 20 headphones, inserts, or sound-field speakers, rely on pre- 

the probe at the desired position within the ear canal. senting acoustic energy to the ear of the individual in a 

4. REM test results vary considerably depending on the manner which is not representative of sound delivery under 
placement of the reference microphone near the ear. realistic listening conditions. Conventional audiometers 
The errors are especially significant at frequencies of 6 present various tones, speech, and noise stimuli to each ear 
kHz and higher (see Mueller, H. G., Hawkins, D. B., 2 5 individually and thus are not capable of investigating the 
Northern, J. L., Probe Microphone Measurements: individual's binaural integration advantage, or of assessing 
Hearing Aid Selection and Assessment, 1992, pp. the hearing function in a three-dimensional sound environ- 
72-74). ment. 

5. REM instruments employ sound field speakers in a Another major disadvantage of conventional audiometry 
room with ambient background noise that often 30 methods is the inability of such methods to assess accurately 
exceeds 50 dB SPL across standard audiometric fre- and objectively, in absolute physical terms such as dB SPL, 
quencies. This necessitates stimulus levels of 60 dB or the hearing function of an individual with respect to the 
higher to produce measurements having sufficient inside of the ear canal to correlate unaided evaluation results 
signal-to-noise ratios. This is problematic if hearing aid to hearing aid requirements. One exception is the probe- 
performance characterization under low level acoustic 35 mike-calibrated fitting system developed by Ensoniq, which 
stimuli is required. only addresses testing accuracy (see Gauthier, E. A., 

IV. The problem of correlating diagnostic, prescription Rapisadri, D. A., A Threshold is a Threshold is a Threshold 

formulae, and real ear measurements. . . . or is it?: Hearing Instruments, vol. 43, no. 3, 1992). 

A significant factor that contributes to the results of a Furthermore, conventional audiometry instruments and 

hearing aid fitting is the problem of adequately correlating 40 methods are not capable of simulating the electroacoustic 

diagnostic data with fitting needs of the hearing-impaired performance of one or more prescribed hearing aids and 

individual. Diagnostic measurements are typically taken in assessing their simulated function in realistic acoustic con- 

dB HL with transducers that are calibrated in 6-cc couplers. ditions relevant to the individual's unique listening require- 

Hearing aid specification and performance measurements ments. 

employ 2-cc couplers which do not represent the real-ear. 45 The master hearing aid concept, which gained some 

Fitting involves the use of one of several prescriptive popularity in the '70s and '80s, involves an instrument that 

formulae, with results that are known to vary as much as 15 presents simulated hearing aids to the hearing aid user (see 

dB for the same diagnostic data across standard audiometric Selection Instrumentation/Master Hearing Aids in Review, 

frequencies (see Mueller, H. G., Hawkins, D. B., Northern, Hearing Instruments, Vol. 39, No. 3, 1988), Veroba et al 

J. L., Probe Microphone Measurements: Hearing Aid Selec- 50 (U.S. Pat. No. 4,759,070, Patient Controlled Master Hear- 

tion and Assessment, 1992, p 107). These fitting formulae ingAid, Jul. 19, 1988) describe a patient controlled hearing 

incorporate statistically based conversion factors that sim- aid module that is inserted into the ear canal and connected 

plify the correlation of hearing aid requirements to a par- to a test module which offers multiple signal processing 

ticular hearing impairment. However, averaged conversion options, e.g. analog circuit blocks, to the individual. Hearing 

factors are known to vary considerably with respect to 55 aid characteristics are determined by a tournament process 

objectively measured individual conversion factors. of elimination, while the hearing-impaired person is pre- 

Several methods and protocols have been suggested to sented with real- word sounds played back from tape decks 

alleviate errors associated with measurement errors and data via a set of speakers located around the hearing-impaired 

correlation (see Sandberg, R., McSpaden, J., Allen, D.,Real person's head. The system's fitting process is based on 

Measurement from Real Ear Equipment. Hearing 60 subjective responses of the hearing-impaired who must 

Instruments, Vol. 42, No. 3, 1991, pp. 17-18). However, continuously decide on an alternative signal processing 

many of these protocols have not yet been widely accepted option, and supposedly eventually arrive at an optimal 

due to limitations of conventional audiometry and Real-Ear fitting. 

Measurement (REM) equipment and other factors related to The fitting process via the Veroba system, commercially 

efficiency of the proposed protocols in clinical setups. 65 known as the Programmable Auditory Comparator, an 

Hearing rehabilitation through the use of hearing aids essentially obsolete product, does not involve any objective 

remains the only viable option for many hearing impaired measurements or calculations for selecting and fitting of the 
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hearing aid. In fact, the entire fitting process is based on the 
subjective response of the hearing impaired person. Clearly, 
most hearing impaired individuals, on their own, cannot 
explore in a timely and efficient manner the spectrum of 
various complex and interrelated electroacoustic parameters 
of a hearing aid under various listening environments. A 
serious limitation of Veroba is that it does not teach how to 
assess objectively the performance of the simulated hearing 
aid, nor does it teach how the aided performance is related 
to the individual's unaided response determined previously 
during the audiometric evaluation process. 

A major unsubstantiated claim in Veroba' s system is the 
simulation of a realistic acoustical environment via tape- 
deck playback and speakers located around the head of the 
hearing-impaired individual. However, recorded acoustic 
signals that are played back are further subjected to acoustic 
modifications due to speaker characteristics, speaker posi- 
tion with respect to ear/head, and acoustic characteristics of 
the room, i.e. wall reflections and acoustic absorption. 
Without factoring in all of the specific acoustic modifiers in 
the transmission channel between the tape-deck and the 
individual's ear, a realistic listening condition cannot be 
achieved with Veroba or any such system. Furthermore, 
Veroba is not capable of manipulating the acoustic condition 
from its recorded form, e.g. by projecting an audio source in 
a specific location within a three-dimensional acoustic space 
with a specific acoustic boundary condition. 

Another hearing aid simulator, the ITS-hearing aid simu- 
lator developed by Breakthrough, Inc. offers computer digi- 
tal audio playback of digital recordings obtained from the 
output of various hearing aids (see ITS-Hearing Aid 
Simulator, Product brochure, Breakthrough, Inc., 1993). 
Each recording segment represents a specific acoustic input, 
listening scenario, hearing aid model, and hearing aid elec- 
troacoustic setting. The recording segments require memory 
space either on a hard disk or other known forms of memory 
storage devices, such as compact-disk read-only-memory. 
This digital-recording-based approach renders impractical 
the arbitrary selection of a hearing aid, hearing aid setting, 
and input stimulus for a hearing-impaired individual, when 
considering all the possible combinations. Furthermore, the 
effects of hearing aid vent sizes, and associated occlusion 
effect, insertion depth, and individual external ears, cannot 
be simulated with the proposed hearing aid simulator 
because it relies on conventional transducers, i.e. head- 
phones and insert earphones. 

For similar reasons, many other commercially available 
master hearing aid systems, do not have the ability to 
simulate accurately a hearing aid in a realistic listening 
environment. Furthermore, these systems do not include 
objective measurement methods for evaluating simulated 
aided versus unaided conditions. For these and other 
reasons, virtually all dispensed hearing aids today are fitted 
without the use of master hearing aid or hearing aid simu- 
lator instruments. 

State-of-the-art REM equipment allows for in-the-ear- 
canal acoustic response measurements. The acoustic stimuli 
are typically generated by the REM equipment itself and 
delivered via a speaker, typically positioned at 0° azimuth, 
or with two speakers positioned at 45° azimuth, with the 
respect to the transverse plane of the head. The response 
measurements, i.e. free-field to real-ear transfer function, are 
essentially one-dimensional since they only provide a single 
transfer function per ear in a particular speaker-ear 
relationship, and are thus not capable of establishing a 
multi-dimensional profile of the real-ear response. Another 
disadvantage of conventional REM equipment and methods 
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is the lack of real speech stimuli presentation because most 
REM equipment only offer pure-tone, pure-tone sweep, 
speech-noise and other speech-like stimuli. These stimuli do 
not explore responses to particular speech segments that 
5 may be important to the hearing-impaired individual during 
unaided and aided conditions. 

Recent developments relating to electroacoustic hearing 
aid measures involve the testing of hearing aids in more 
realistic conditions. Real speech signals instead of pure 
10 tones and speech-like noise signals were employed in a 
recommended test protocol; and spectrogram plots indicat- 
ing temporal, i.e. time, analysis of the acoustic energy in dB 
SPL versus frequency was compared for hearing aid input 
versus output (see Jamieson, D., Consumer-Based Electroa- 
15 coustic Hearing Aid Measures, JSLPASuppl. 1, Jan. 1993). 
The limitations of the proposed protocol include: limited 
acoustic reality due to the specified sound delivery method 
via a speaker to a hearing aid in an enclosed chamber; and 
limited value of the spectrogram plots which do not directly 
20 indicate the relationship of the plot to audibility and loud- 
ness discomfort. 

Other recent developments involve three-dimensional 
sound presentation via headphone transducers (see 
Wightman, F. L., Kistler, D. J., Headphone Simulation of 
25 Free-Field Listening. I: Stimulus Synthesis, JASA. vol. 85, 
no. 2, 1989, pp. 858-867; and Wightman, F. L., Kistler, D, 
J., Headphone Simulation of Free-Field Listening. II: Psy- 
chophysical Validation, JASA. vol. 85, no. 2, 1989, pp. 
868-878). These three-dimensional effects are achieved by 
30 recreating the in-the-ear-canal acoustic response to free-field 
signals via headphones or speakers (see U.S. Pat. No. 
4,118,599, Stereophonic Sound Reproduction System, Oct. 
3, 1978; U.S. Pat. No. 4,219,696, Sound Image Localization 
Control System, Aug. 26, 1980; U.S. Pat. No. 5,173,944, 
35 Head Related Transfer Function Pseudo-Stereophony, Dec. 
22, 1992; U.S. Pat, No. 4,139,728, Signal Processing 
Circuit, Feb. 13, 1979; and U.S. Pat. No. 4,77 '4,515, Altitude 
Indicator, Sep. 27, 1988). This involves digital filtering of 
source signals based on head-related-transfer-function 
40 (HRTF). The HRTF, essentially real-ear unaided response 
(REUR) in three-dimensional space, is a frequency depen- 
dent amplitude and time delay measurement that results 
from head shadowing, pinna, concha, and ear canals. The 
HRTF enables extern alization of localized sound with head- 
45 phones. Source signals that are processed with HRTF pro- 
vide the listener with free-field listening experience accord- 
ing to the controls of the signal processing parameters. 

Present research and development efforts in three- 
dimensional audio is mainly focused on commercial musical 
50 recordings, playback enhancement, and human-machine 
interface enhancement (see Bagault, D. R., Call Sign Intel- 
ligibility Improvement Using a Spatial Auditory Disaply, 
Ames Research Center, NASA Technical Memorandum 
104014, April 1993; and Begault, D., Wenzel, E., Head- 
55 phone Localization of Speech, Human Factors, 25 (2), pp. 
361-376, 1993) and virtual reality systems (see The 
Beachtron-Three-dimensional audio for PC -compatibles, 
reference manual, Crystal River Engineering, Inc., Revision 
D, November, 1993). The object of these three-dimensional 
60 audio systems has been limited to simulating situational 
awareness in an approximate virtual acoustic environment 
since non-individualized HRTF set is typically employed. 

The application of three-dimensional audio in objective 
in-the-ear-canal assessment of hearing in the unaided, simu- 
65 lated aided, and aided conditions would be a significant and 
extremely helpful departure from known audiometric tech- 
niques. 
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SUMMARY OF THE INVENTION conditions represent listening scenarios that are associated 
The invention provides a virtual electroacoustic audiom- ^ f amative response data. An example of a generalized 
eter (VEA), which is a system used in the assessment of mode i 15 « audiologic word hst, such as W-22, having a 
human hearing function in the unaided, simulated aided, and s P ec ' fic spatialized background noise. Test scores are corn- 
aided conditions. A pair of intra-canal prostheses (I CP) are 5 P ared f lth S eneral model normallve da ' a stored ™ the 
placed in the two ear canals of an individual to deliver s > rslem s memor y- 

acoustic stimuli. A probe measurement system, partially The VEA system also simulates other hearing aid effects 

inserted in the ICP, measures the in-the-ear-canal response that can not be simulated by the digital synthesis process due 

conditions near the tympanic membrane during all hearing t0 the unique effects of the individual ear. These include the 

evaluation, thus providing a common reference point for 10 occlusion effect, venting size, and oscillatory feedback 

correlating responses in the unaided, simulated aided, and potential. The occlusion effect is a phenomenon that results 

aided evaluation conditions. A unique modular hearing aid in changes to the perceived characteristics of the individu- 

defined in accordance with the results of such hearing al J s own voice when the ear canal is occluded with a hearing 

assessment is also provided that includes highly config- a ^ d - 

urable electroacoustic and electronic signal processing ele- 15 In addition, the VEAsystem offers a method of measuring 

ments. various individualized acoustic transfer functions in a three- 

During unaided evaluation, the system performs audio- dimensional space, which are incorporated during the vari- 

metric tests, such as pure tone thresholds, uncomfortable ous synthesis processes to create virtual acoustic conditions 

loudness levels (UCL), speech reception threshold, and 2Q for an individual. 

speech discrimination. These peripheral hearing tests, as BRIEF DESCRIPTION OF THE DRAWINGS 
well as other central auditory processing (CAP) tests, evalu- 
ate the hearing function of the human in response to acoustic 
stimuli measured near the tympanic membrane in absolute 
sound pressure level (SPL) terms, unlike conventional 



FIG. 1 is a block level schematic diagram showing the 

major components of the VEA system, including dual ICP 

prostheses inserted in the ear canal of an individual; a probe 

. . , , . , . , , . , n 25 microphone system; and a computer system including a 

stimuli which are presented in relatrve hearing level (HL) audio y synthesizer mod X, a J igital audiome 6 ter 

erms ' module, and a virtual acoustic space measurement module 

Another significant feature of the VEA is its ability to according to the invention; 



synthesize, or create, acoustic signals that are representative 
of signals received in real listening environments in a 
three-dimensional space. This is achieved by incorporating 
the various filtering effects of room acoustics, atmospheric 



FIG. 2 is a block level schematic diagram of a digital 
30 audio synthesizer module according to the invention; 

FIG. 3 is a block level schematic diagram of a digital 



, . vi • . i j i j * i audiometer module according to the invention; 

absorption, spreading loss, interaural delay, and spectral _„ A . , , , t , , . 

shaping of external ear, and other body effects. For example, ; 4 15 a block level senate diagram of a virtual 

a listening condition representing a teacher-talker in class- 35 acoustlc s P ace measurement module according to the mven- 

room is digitally synthesized and acoustically delivered via tl0n > 

the ICP to a child to assess his/her unaided and aided FIG - 5 is a block level schematic diagram of a virtual 

listening ability in a classroom environment. Spatialized acoustic s P ace measurement system according to the inven- 

competing signals representing school children noise is tl0n > 

optionally presented in addition to the spatialized primary 40 FIG. 6 is a perspective view of an adjustable chair used for 

speech signal, i.e. the teacher, to assess further the child's positioning a patient's head during virtual acoustic space 

speech discrimination ability in the presence of background testing; 

noise. FIG. 7 is a schematic diagram showing speaker arrange- 
The unaided evaluation method involves both ears in the ment m a virtual acoustic space measurement system, 
listening experience similar to the way humans normally 45 including transverse plane speakers, and sagittal plane 
hear sounds, with each ear receiving a portion of the acoustic speakers according to the invention; 
energy according to the relationship between each ear and FIG. 8 is a schematic diagram showing an example of 
the various virtual audio sources. In contrast, conventional transfer function interpolation at a point i 3 from transfer 
audiometry methods present intracranial acoustic stimuli to functions, measured at points m a and m 2 in a two- 
each ear individually, for example, speech to one ear, and 50 dimensional transverse plane according to the invention; 
competing noise in the opposite ear. FIG. 9 is a schematic diagram showing an example of 
The simulated aided assessment of the VEA system is realization of a realistic listening scenario for unaided hear- 
accomplished by incorporating the electroacoustic perfor- ing evaluation conditions, and in particular showing a 
mance of a desired hearing aid into the unaided digital teacher- talker/child-listener scenario including direct acous- 
synthesis of acoustic signals. The simulated hearing aid 55 tic P aths V R1 and P X1 and early reflection paths P^ and ? L2 
electroacoustic parameters include microphone and receiver to the right and left ears of the child-listener according to the 
transfer functions, and amplifier and filter characteristics. invention; 

Specific or generalized acoustic models are digitally pre- FIG. 10 is a block level schematic diagram showing an 
sented to the input of the simulated hearing aid process. example of realization of a realistic listening scenario for 
Specific acoustic models represent listening scenarios that 60 unaided hearing evaluation conditions, and in particular 
are important to the individual under evaluation and that showing a process representation of a teacher-talker/child- 
may be selected and manipulated by the operating clinician, listener scenario during unaided evaluation according to the 
for example a teacher-talker source model in a classroom invention; 

environment model with a specific source-ear relationship. A FIG. 11 is a partially sectioned, perspective view showing 

typical goal in such a specific scenario is to maximize speech 65 an intra-canal prosthesis (ICP) for an ICP-ITE representing 

intelligibility by optimizing the electroacoustic characteris- hearing aids for shallow ear canal placement according to 

tics of the simulated hearing aid. Generalized acoustic the invention; 
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FIG. 12 is a partially sectioned, perspective view showing 
an intra-canal prosthesis (ICP) for an ICP-ITC representing 
hearing aids for deep ear canal placement according to the 
invention; 

FIG. 13 is a perspective view showing an intra-canal 
prosthesis (ICP) face-plate end, including face-plate probe 
tube holders and probe tube placement according to the 
invention; 

FIG. 14 is a partially sectioned, side view showing an ICP 
core module for a two-part ICP configuration according to 
the invention; 

FIG. 15 is a partially sectioned, side view showing 
adjustable vent inserts and an ICP-ITE sleeve for an ICP- 
ITE configuration according to the invention; 

FIG. 16 is a partially sectioned, side view showing an 
ICP-ITC sleeve for a two-part ICP configuration according 
to the invention; 

FIG. 17 is a partially sectioned, side view showing a 
complete two-part ICP-ITC assembly according to the 
invention; 

FIG. 18 is a partially sectioned, side view showing an ICP 
having a programmable vent according to the invention; 

FIG. 19 is a partially sectioned, side view showing a 
hearing aid and direct acoustic coupling method to an ICP, 
including direct acoustic coupling via a magnetic attraction 
method according to the invention; 

FIG. 20 is a partially sectioned, side view showing a 
hearing aid and direct acoustic coupling method to an ICP, 
including direct acoustic coupling via an acoustic coupler 
method according to the invention; 

FIG. 21 is a partially sectioned, side view showing a 
hearing aid and direct acoustic coupling method to an ICP, 
including a programming and acoustic coupling interface 
according to the invention; 

FIG. 22 is a partially sectioned, side view showing a 
hearing aid and acoustic coupling to an ICP via an acoustic 
coupler tip according to the invention; 

FIG. 23 is a block level schematic diagram showing an 
example of a fitting process provided by the virtual elec- 
tro acoustic audiometer system according to the invention; 

FIG. 24 is a graphic computer generated display showing 
a reference measurements module according to the inven- 
tion; 

FIG. 25 is a graphic computer generated display showing 
an unaided evaluation module according to the invention; 

FIG. 26 is a graphic computer generated display showing 
a predicted aided module according to the invention; 

FIG. 27 is a graphic computer generated display showing 
a simulated aided evaluation module according to the inven- 
tion; 

FIG. 28 is a graphic computer generated display showing 
an aided evaluation module according to the invention; 

FIG. 29 is a line graph plotting the variability of measured 
SPL versus distance of probe tip from tympanic membrane 
for 5 kHz and 15 kHz tones for an individual according to 
the invention; 

FIG. 30 is a bar graph plotting the measured SPL for 5 
kHz and 15 kHz during probe advancing at 6 mm from 
tympanic membrane according to the invention; 

FIG. 31 is a bar graph plotting the measured SPL for 5 
kHz and 15 kHz during probe advancing at 5 mm from 
tympanic membrane according to the invention; 

FIG. 32 is a bar graph plotting the measured SPL for 5 
kHz and 15 kHz during probe advancing at 4 mm from 
tympanic membrane according to the invention; 
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FIG. 33 is a block level schematic diagram showing an 
example of a teacher-talker/child-listener scenario using 
predicted aided evaluation for the right ear according to the 
invention; 

5 FIG. 34 is a block level schematic diagram showing an 
example of a teacher-talker/child-listener scenario using 
simulated aided evaluation for the right ear according to the 
invention; 

FIG. 35 is a block level schematic diagram showing a 
10 simulated hearing aid with directional microphone accord- 
ing to the invention; 

FIG. 36 is a block level schematic diagram showing an 
example of the realization of realistic listening scenarios for 
5 aided hearing evaluation conditions according to the inven- 
tion; and 

FIG. 37 is a block level schematic diagram showing an 
example if the prediction and simulation of oscillatory 
feedback of a simulated hearing aid. 

DETAILED DESCRIPTION OF THE 
INVENTION 

For purposes of the description herein, the following 
definitions shall be consistently applied: 

25 Window: Refers to a graphical area displayed on a com- 
puter screen, that represents a collection of controls, objects, 
entry fields, and plots, that are grouped together according to 
a logical functional manner. 

3Q Iconized: Refers to an active window that is shown as an 
icon. Its display is disabled but may be enabled by clicking 
on the icon on the computer screen. 

The virtual electro acoustic audiometer (VEA) described 
herein is a unitary instrument that is used in the hearing 

35 assessment in the unaided, simulated aided, and aided con- 
ditions. The VEA also offers new methods for hearing aid 
fitting and analysis using a combination of digital synthesis 
of realistic acoustic stimuli and in-the-ear-canal response 
measurements throughout the assessment and fitting pro- 

40 cesses. 

FIG. 1 shows the main components of the preferred 
embodiment of the VEA system 15. A pair of intra-canal 
prostheses (ICP) 22 is inserted in the ear canal 21 of an 
individual for delivering acoustic stimuli 25 in a manner 

45 similar to that of a hearing aid. Each ICP contains a receiver, 
i.e. a speaker, for transmitting acoustic signals to the tym- 
panic membrane 26. The ICP also contains a probe tube 24 
for measuring the acoustic response that results from the 
unique interaction of the receiver-produced acoustic stimuli 

50 and the ear-canal characteristics of the individual. A probe 
microphone system consisting of a probe tube 24 and probe 
microphone 23 measures acoustic signals from the ear canal 
21 and provides electrical signals representative of the 
acoustic signals. A response keyboard 27 is provided to 

55 register a response from the test subject 20 during various 
hearing evaluation tests. 

Each ICP receiver 22 is electrically connected to a digital 
audiometer module 19 that provides an interface to various 
audiometric transducers including the ICP receiver 22 and 

60 probe measurement system 23. The digital audiometer mod- 
ule is connected to a digital audio synthesizer module 18 and 
a virtual acoustic space measurement module 14 via various 
inter-module cables. The virtual acoustic space measure- 
ment module includes an output terminal 16 for connection 

65 to a plurality of test speakers. These modules may be 
contained at or within a standard personal computer (PC) 11 
that also contains standard computer accessories such as 



5,825,894 

13 14 

memory storage devices 17, a display monitor 10, a key- municate with the patient via the ICP pair. The patient 

board 12, and a mouse 13. Memory storage devices are microphone allows the patient to communicate back to the 

collectively referred to as system memory 17. operating clinician during certain audiometric tests that 

Block diagrams of the digital audio synthesizer, digital require verbal responses from the patient. The patient micro- 
audiometer and virtual acoustic space measurement modules 5 phone is also used in occlusion effect measurements, as are 
are shown in FIGS. 2, 3, and 4. described in more detail below 

In the exemplary embodiment of the invention, the digital The digital audiometer module also includes a PC-BUS 

audio synthesizer, digital audiometer, and virtual acoustic connection 43 and PC-BUS interface circuit 44 that link the 

space measurement modules are connected to the personal digital audiometer module to the VEAto coordinate module 

computer system via the Industry Standard Architecture 10 operation at the system level. 

(ISA)-bus interface 34 and ISA-bus 39 of the personal The VEA also includes a virtual acoustic space measure- 

computer (see, for example FIG. 2). Digital data represent- ment system (FIG. 5) that is used to evaluate the individual's 

ing audio sources are retrieved from the system memory via acoustic transfer function set. A block diagram of the virtual 

the bus interface 34, and are digitally processed by a digital acoustic space measurement module 14 is shown in FIG. 4. 

signal processor 33 within the digital audio synthesizer 15 The virtual acoustic space measurement module receives 

module 18. The digitally processed data are then converted electrical signals, representing various acoustic signals, 

to analog form using an digit al-to- analog converter 35 that from the digital audio synthesizer module output connectors 

typically operates at conversion rate of 44.1 kHz, or at 38 via a set of input connectors 64. Input signal level 

another rate depending on the desired signal bandwidth adjustment and routing is accomplished via a mixer circuit 

required, 20 65, an audio amplifier circuit 66, and a speaker routing and 

The digital audio synthesizer module also receives analog interface circuit 71. The output of the virtual acoustic space 

signals representing audio signals via its input connector 31 measurement module is thence coupled to various test 

from external audio sources such as tape or CD players (not speakers in a speaker array 16. 

shown). Received analog signals are converted to digital The virtual acoustic space measurement module also 

signals by the analog-to-digital converter 32 for signal 25 includes a PC-BUS connection 68 and PC-BUS interface 

processing via digital signal processor 33. circuit 67 that link the virtual acoustic space measurement 

Multiple digital audio synthesizer modules (not shown) module to the VEA to coordinate module operation at the 

may be used to enhance the system's digital signal process- system level. Such coordination includes processing infor- 

ing capability. This is particularly useful for parallel real- 3Q mation indicative of patient head position connected to the 

time binaural signal synthesis. Multiple digital audio syn- module from a patient head positioning sensor via a con- 

thesizer modules are cascaded by connecting the output 38 nector 70 and a positioning sensor interface circuit 69. 

of one digital audio synthesizer module to the auxiliary input An adjustable chair 78 is preferably used to ensure proper 

30, or input 31 of another digital audio synthesizer module, ear positioning within the measurement space, as shown in 

The internal and auxiliary signals are combined within the 35 FIG. 6. A vertical adjustment lever 79 adjusts the vertical 

module at a summing node 36 prior to output. In the position of the individual on the chair. A back adjustment 

preferred embodiment of the invention, two digital audio knob 81 adjusts a chair back support 80. The head support 

synthesizer modules are used. Each module employs a 82 is adjustable to support the head of the individual seated 

Motorola DSP56001 digital signal processor clocked at 40 on the chair. An ear position reference arm 84 provides a 

MHz. 40 target reference by pointing a set of ear canal opening 

The analog output 38 from the digital audio synthesizer pointers 83 to the individual's ear canal openings. The ear 
module 18 is routed to the mixer 45 of the digital audiometer position reference arm 84 is preferably removable from the 
module 19 (FIG. 3) via a connector 42. Analog audio signals ear area via a reference arm vertical adjustment knob 85 to 
received at the digital audiometer module are mixed via minimize acoustic reflections into the ear area during trans- 
mixer circuit 45, amplified via an audio amplifier circuit 46, 45 f er function measurements. 

and impedance matched and routed to various audiometric An infrared tracking method (not shown) may also be 

transducers via an audiometric transducer interface circuit used to position and maintain the head in the proper position 

49. Outputs to audiometric transducers include I CPs 50 with respect to the speaker array 16, FIG. 5; 89-94, FIG. 7). 

(discussed above, and in further detail below), bone vibra- A light- reflective target object (not shown) placed just 

tors 51 (not shown), a headphone 52 (not shown), and other 50 below the ear lobe of the individual, may be used to reflect 

conventional methods of delivering sounds to the ear of an the infrared light from the incident infrared light emitter, 

individual. Proper ear placement is indicated by reflected light which is 

Amplified signals from the audio amplifier 46 are also detected by the positioning sensor interface 69 (FIG. 4). 

sent to the digital audio synthesizer module input 31 from an The virtual acoustic space measurement system generates 

audio buffer circuit 47 output connection 48. The mixer 55 various sets of transfer functions that are used during the 

circuit 45 also includes connections for receiving audio hearing evaluation process. Generally, a transfer function of 

signals from ICP microphones 55, an operating clinician a linear system defines a complex function H(jw) having 

microphone 56 (not shown), and a patient microphone 57 magnitude and phase characteristics that are dependent on 

(not shown), via a microphone amplifier 58. frequency (w). Once a transfer function H(jw) is determined, 

External line-level signals received at input connectors 53 60 a system's response to an arbitrary input signal can be 

are also amplified via an amplifier 54 and sent to mixer predicted or synthesized. 

circuit 45. A response keypad interface circuit 60 is The transfer function set in the virtual acoustic space 

employed to interface the system to the response keypad via measurement system is obtained from a set of acoustic 

a connector 59 to register an individual's response to acous- sources, such as speakers, positioned in a three-dimensional 

tic stimuli during various audiometric evaluation processes. 65 space. The preferred speaker setup is an array of six speakers 

The operating clinician microphone, connected to the digital 89-94 positioned at an equal distance (d) from a patient head 

audiometer module, allows the operating clinician to com- reference point 88, as shown in FIGS. 5 and 7. The head 
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reference point 88 is defined as the point bisecting the line Similarly, interpolation can be used to approximate any 

joining the centers of the openings of the ear canal 21. transfer function at an arbitrary point in a three-dimensional 

Four of the speakers, i.e. #1(89), #2 (90), #3 (91), and #4 s P ace fr ° m the weighted average of the nearest set of 

(92) are located in the transverse plane 95 containing the measured transfer functions. The accuracy of interpolated 
head reference point 88. Speakers 1 through 4 are positioned 5 functions can be improved if additional measurements are 
at azimuth angles 0°, 45°, 315", and 270°, respectively, as made ^ addltl0 ° al s P ea 1 cers and ^ speaker-head orienta- 

u - TJif^ t * a tt-. e*u i ■ #1 ✓eo\ #e tions. The preferred embodiment of the invention employs a 

^ n in , ^' To a ^ e f ^he speakers, ix #1 89), #5 practical compromise between the number of speakers, e.g. 

(93) , and #6 (94) are located m the sagittal plane 96 ^ {q ^ emb ^ iment of the invention desc ribed herein, and 
containing the head reference point 88 Speakers #1 #5, and individual ori entations, e.g. two: a front and a back orien- 
#6 are positioned at altitude angles of 0 , 45 , and -45 , io tation Furthermorej non . H near weighting for transfer func- 
respectively, as shown in FIG. 7 at B. tion interpolation may be more appropriate if determined 

A set of transfer functions for the six-speaker configura- from statistical data obtained from transfer function mea- 

tion shown in FIG. 7 allows six pairs, i.e. right and left ear surements of large number of individuals, 

measurements, of frontal measurements where the head is Other transfer functions measured by the VEA system 

facing speaker #1. An additional six pairs of back measure- 15 include: 

ments are preferably taken where the head is facing opposite (1) the H t - c/ ^ rec (jw) transfer function, which represents the 

(not shown) to speaker #1. Accordingly, a complete transfer ICP receiver to in-the-ear-canal electroacoustic transfer 

function set consists of 12 pairs of measurements that function, as measured by a probe when the ICP is 

represent finite points in a sphere of a radius (d). Of the positioned in the ear canal of the individual; 

twelve paired measurements, eight paired measurements are 20 (2) the H icp _ mic (jw) transfer function, representing the 

in the transverse plane and six paired measurements are in electroacoustic transfer function from an ICP speaker 

the sagittal plane. Two paired measurements are common to t0 the microphone of the hearing aid used during the 

both planes. Paired measurements contain not only indi- hearing aid evaluation; and 

vidual transfer functions for each ear, but also contain the ( 3 ) the H / c wbG w ) transfer function, representing the 

interaural phase relationship with respect to each speaker. 25 acoustic leakage, i.e. acoustic feedback, from the 

. £ £ . . u , c , receiver of the ICP measured at face-plate of the ICP. 

A transfer function measurement set with a pair or probes The transfer functions H ( 'vA H ( 'vA H 

placed near the tympanic membrane in the unoccluded ear x ^ T rans & [. x nc l0 , n ^ T ua fp r"' i /' tcp-rec 

i- c j \ f ■ .j j 4. c cl (iw), H f>F1 (iw), and H f> „ «,(iw) are employed m various 

canal is referred to herein as the unaided transfer function u '* lc ?: mic y j\ . „ *cp-fl£ / * J . 

TT / .x , r i j^ju combinations to digitally synthesize acoustic signals, repre- 

H Mfl (p„,Jw), where p„ is the location of speaker n denned by n . , s . \ J . , , . J 

H «vimj /j rn i ^ j 30 sen tmg unaided, simulated aided, or aided listening 

polar coordinates d, 8, and a, where d is the distance ? . . ' . 4 . . ' . U1 ... & 

f 4 4l _ , \ , \ c • * u conditions, with realism that is not possible with conven- 

between the speaker and the head reference point as shown , ' . , 4U , r 

- vrn n , a a v iU~ ^- m ^u ori „-u ~f JL„,i tional evaluation and fitting methods, 

in HO. 7 at A. 8 is the azimuth angle or sound incidence T n . - & , „ 1A1 , , , 

... 4l i u • -nr^. t * a In FIG. 9, for example, a teacher-talker 101 and a child- 

with the respect to transverse plane as shown m FIG. 7 at A.; i ' . y 4 1AA . . « - „ 

, . ,u n-* j 1 -*u * * *u i i listener 102 acoustic environment 100 is created as follows: 

and a is the altitude angle with respect to the sagittal plane 4 . , , n . + , 

as shown in FIG 7 at B H fp iw) represents the acoustic 35 direct acoustlc P aths P/?i and Pz.i' and reflect ion paths Pi?2 

- - j and p, ? , for right and left ears of the child-listener 102 are 

transfer function that results from sound propagation from a j i_ * c c *• • * 

. „ , . . . u u ■ represented by transfer functions interpolated from previ- 

speaker #n to the tympanic membrane when various acoustic * J , 4 f _ _ . r r 

r r 4 . j j . i j * ♦ u ■ *• ously measured transfer functions or the child, 

factors are considered, including atmospheric propagation . . f the environment of FIG 9 is 

losses, effects of head, torso, neck, pinna, concha, ear canal, , e aC0 1 l^ C J f a 10 P.° U e ^y^ 011 ^ 11 0 • ls 

. , • i 40 shown in FIG. 10, m which a digital audio file 107 that 

tympanic membrane, and middle ear impedance, * * i_ I « u • * • j r 

J * „ o , ' -t , 111 represents teacher-talker speech is retrieved from a system 

Transfer function measurements with a probe tube placed mem 106 and di itally processed by digital signal pro . 

on the face-plate of the ICP may also be made These cessQr m The digital signal processor perlbrras signal 

measurements are referred to herein as H fp (p jw) which ocesses H ^ j w) 108 H q, jw) 110j H „ a ( Pi?2 , jw) 

represent the transfer function from a speaker #n to a 45 109 and H ^ jw) nij which represen t the paths P/?1 , 

face-plate (fp) of the ICP (discussed m more detail below), and reS pectively. Right and left ear path 

at a location representative of the microphone position on a processes are summed at summil3g node s 112 and 113 and 

face-plate of a simulated heanng aid. afe further processed with inverse transfer functions, W icp _ 

Generally a transfer function H(p(d,9,a), jw) at an arbi- wc „ Rt q w j ( 116 ) and i/H f ^.-U Qw) (104), for right and 

trary point p rf , 8,a in space at coordinates d, 6, and ,a can 50 le f t JC p receivers 119/120, respectively, 

be interpolated from the set of measured transfer functions mV erse transfer functions are provided to cancel the 

as shown in FIG. 8. For example, it is known that the sound acoustic transfer function that occurs between the ICP 

pressure from an audio source is inversely proportional to receiver and the residual volume of the ear canal as the 

distance in normal atmospheric conditions. Furthermore, a sound j s delivered. The processed right and left digital 

transfer function of a point in space can be approximated by 55 s i gna i s are then converted to analog signals via a digital-to- 

the weighted average of the two nearest measured transfer analog converter 115 and routed to right and left ICPs via an 

functions. FIG. 8. shows an example of an approximate audiometric interface circuit 117. The process of projecting 

transfer function H(i 3 , jw) interpolated in the transverse a virtual audio image to a listener at a particular point in a 

plane at point i 3 from transfer functions H (i l7 jw) and H (i 2 , three-dimensional space, such as teacher-talker speech to a 

jw), which are also interpolated from transfer functions 60 child-listener, is referred to as spatialization. 

H(m 1? jw) and H (m 2 , jw) measured with speakers #1 (89) Alternatively, live-voice signals from the operating clini- 

and #2 (90). c j an via the operating clinician microphone can be used, 

Thus; instead of digital audio data, for spatialization and delivery 

rr/ . . wrr/ . . rr/ . N1 r „, to the listener wearing the ICP pair. The virtual position and 

mh>J»H* {rn liM ^jwm^ al (jwn [i] 65 vQlume Qf the spatialized audi0 are under ^ CODtrol 

where L at (jw) is the atmospheric loss transfer function due of the virtual audiometer system of the present invention, as 

to atmospheric absorption and spreading roll-off of sound. is explained in more detail below. 
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Transfer function measurements of linear time-invariant ing and generation, which is performed by the audio syn- 

systems, such as the transfer functions H ua (p„, jw), H^,(p„, thesizer board of the computerized virtual electroacoustic 

jw), H /C ^ rec (jw), Kicp-mic G w )> and H^pQw), typically audiometer system. FIGS. 11 and 12 show ITE and ITCICPs 

employs discrete or swept pure tone acoustic stimulus. Other that represent hearing aids having shallow and deep canal 

stimuli include speech-noise, white-noise, and other speech- 5 placement, respectively. 

like noise signals. Pseudo-random noise sequences and other The receiver 136 used in the preferred embodiment of the 
signals have also been used to reduce the time required to present invention (manufactured by the Knowles Corp. of 
compute the transfer function. Computational methods Itasca, 111.) was chosen for its acoustic characteristics, which 
include Fast Fourier Transform (FFT), Maximum-Length are similar to receivers used in commercially available 
Sequence (MSL), and Time-Delay Spectrometry (TDS) (see 10 hearing aids, as well as its very low noise output character- 
Rife. D., Vanderkooy, J., Transfer-Function Measurement istics, I CP receiver variations from simulated hearing aid 
with Maximum-Length Sequences, J. Audio Engineering receivers are stored in the VEA system memory as a 
Soc, Vol. 37, No. 6, June 1989, pp. 418-442). The advan- correction transfer function used during various simulation 
tages of MSL and TDS measurement include reduction of processes. The probe tube 133, preferably made of a silicone 
room reflection effects on the transfer function. One impor- 15 rubber material and having a diameter of approximately 1 
tant component of measured transfer functions used in the mm, is inserted in the probe tube canal 134 of the ICP as 
present invention is the direct path transfer function. shown in FIGS. 11-22. 

In the preferred embodiment of the invention, the VEA's A vent canal 130 is preferably provided for pressure 

probe microphones are calibrated at the head reference point equalization in the ICP-ITC versions that have deep canal 

when the VEA is first installed in its clinical setup. These 20 insertion depths (FIGS. 12 and 17), and to accommodate 

calibration data, stored in the system memory, are subse- vent inserts for the ICP-ITE version having shallow canal 

quently used during transfer function measurements to cor- insertion depths (FIGS. 11 and 15), In the ICP-ITE versions, 

rect for the unique frequency response characteristics of a vent canal allows the insertion of various vent inserts into 

each probe microphone used and the unique characteristics the vent canal to achieve desired in situ acoustic character- 

of room acoustics. 25 istics. For example, a vent insert of relatively large diameter 

FIG. 11 is a partially sectioned, perspective view showing may be used to reduce the occlusion effect that results from 

an intra-canal prosthesis (ICP) for an ICP-ITE representing increased perceived volume of the individual's own voice, 

hearing aids for shallow ear canal placement; FIG, 12 is a On the other hand, a smaller vent insert may be used to 

partially sectioned, perspective view showing an ICP for an eliminate acoustic leakage from the receiver via the vent 

ICP-ITC representing hearing aids for deep ear canal place- 30 insert. A miniature connector socket 138 and connector plug 

ment; FIG. 13 is a perspective view showing an ICP face- 123 electrically connects the ICP to the VEA system via 

plate end, including face-plate probe tube holders and probe attached connector cable 125. 

tube placement; FIG. 14 is a partially sectioned, side view The VEA system, in conjunction with the probe micro- 
showing an ICP core module for a two-part ICP configura- phone system, permits measurements of the occlusion 
tion; FIG. 15 is a partially sectioned, side view showing 35 effects versus ICPs and vent types, as is explained later. The 
adjustable vent inserts for an ICP-ITE; FIG. 16 is a partially ICP also contains two probe tube holders 124 and a place- 
sectioned, side view showing an ICP-ITC sleeve for a ment handle 126 for placement of the probe tube, as shown 
two-part ICP configuration; FIG, 17 is a partially sectioned, in FIGS. 11, 12, and 17. FIG. 13 shows a more detailed 
side view showing a complete two-part ICP-ITC assembly; illustration of a face plate 122, including the face plate tube 
FIG. 18 is a partially sectioned, side view showing an ICP 40 holders 124. In the figure, a ICP/ITC sleeve 156, and a 
having a programmable vent; FIG. 19 is a partially hearing aid microphone position 132 are also shown. This 
sectioned, side view showing a hearing aid and direct configuration is used when measuring acoustic leakage 
acoustic coupling method to an ICP, including direct acous- feedback and face-plate transfer functions, 
tic coupling via a magnetic attraction method; FIG. 20 is a The ICP housing (129, FIG. 11; 152, FIG. 12) is prefer- 
partially sectioned, side view showing a hearing aid and 45 ably made of a soft flexible material with acoustic baffling 
direct acoustic coupling method to an ICP, including direct effects to provide comfort and acoustic sealing. Several 
acoustic coupling via an acoustic coupler method; FIG, 21 versions of the ICP can accommodate a variety of ear canal 
is a partially sectioned, side view showing a hearing aid and sizes. For example, a small housing version is more suitable 
direct acoustic coupling method to an ICP, including a for pediatric populations, while a larger version is suitable 
programming and acoustic coupling interface; and FIG. 22 50 for adults who have large ear canals. The ICP, shown in 
is a partially sectioned, side view showing a hearing aid and FIGS. 11 and 12 is preferably disposable to avoid cont ami- 
acoustic coupling to an ICP via an acoustic coupler tip, all nation from individuals who have infected ear canals, 
according to the invention. An alternate embodiment of the invention provides a 

In the foregoing figures, those elements of the invention two-part ICP configuration, as shown in FIGS. 14-17. A 

that are common to the various embodiments have a com- 55 core part 169 (FIG. 14) is inserted in a variety of disposable 

mon numeric designator. For example, the ICP of FIGS. 11 sleeves 177, as shown in FIGS. 15 and 16. This option 

and 12 each have a receiver 136, while the housing 129 in provides an economical alternative to the configuration 

the embodiment of FIG. 11 is different from the housing 152 shown in FIGS. 11-13 because only the sleeve component is 

of the embodiment of FIG. 12. disposable. The core part 169 is encapsulated in a protective 

The intra-canal-prosthesis (ICP), shown in FIGS. 11-22, 60 material, preferably having semi-flexible properties. A 

consists mainly of a receiver 136, a receiver port 199, a decoupling capacitor 167 may be used to filter extraneous 

probe tube 133 inserted in probe tube canal 134, vent inserts electromagnetic signals that cause audible noise. 

128 inserted in vent canal 130, a probe microphone 131, a The sleeve part shown in FIGS. 15 and 16 is typically 

face plate 122, and a housing made of a flexible material, made of flexible material, such as a soft acrylic, such that the 

such as an acrylic. The ICP is generally designed to repre- 65 ICP fits comfortably into a variety of ear shapes and sizes, 

sent physical and electroacoustic characteristics of a desired FIG. 16 shows a sleeve suitable for deep canal insertions, 

type of hearing aid with the exception of the signal process- representing ITC and CIC hearing aid types. Also shown in 
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FIG. 16 is an acoustic baffle system 186 that provides an acoustic coupler 243, as shown in FIG. 20. The extended 

acoustic seal while the ICP is inserted in the ear canal. microphone port 242, unique to the present invention, also 

FIG. 15 shows an ICP sleeve for shallow canal insertions acts as a handle to facilitate insertion and removal of hearing 

representing ITE hearing aid types. The ICP core is inserted aid 214 during its normal use. 

in the sleeve cavity 179 of any ICP, including those shown 5 Another embodiment of the invention, shown in FIG. 22, 

in FIGS. 15 and 16. The specific size of the ICP sleeve employs an acoustic coupler 290 adapted for insertion into 

selected by the operating clinician depends upon the test a microphone port 299 of the hearing aid 214. The micro- 

performed, individual canal size, and hearing aid simulation phone port 299 is recessed to accommodate an acoustic 

requirements. An example of the combined parts of a core coupler tip 291. 

ICP and an ICP sleeve are shown in FIG. 17, which Another acoustic coupling method (not shown) employ- 
represents an ICP-ITC assembly. ees a suction-cup ring to couple the ICP receiver to existing 
FIG. 18 shows a variation of the vent mechanism where conventional hearing aids that are not equipped with special 
the size of the vent is electronically controlled and adjusted interface parts. 

(see Zdeblick, K., A Revolutionary Actuator For One major advantage of the direct acoustic coupling of 

Microstructures, Sensors Magazine, eb. 1993). This is the present invention is to improve the signal-to-noise ratio 

accomplished by employing programmable micro-valve 193 15 at the microphone of the hearing aid while the aid is being 

(such as the NO-300 manufactured by Redwood Microsys- adjusted or evaluated. This is primarily accomplished by 

terns of Redwood City, Calif.) which contains a silicon acoustically isolating the microphone of the hearing aid 

diaphragm 194 which is to regulate the size of the vent from ambient room noise via its coupling to the ICP. 

attached to the vent canal 197 via the micro-valve port 195. Hearing aids of the present invention also employ a probe 

Typical vent size range is between 0.032 and 1.5 mm, 20 tube canal to allow for probe tube insertion and subsequent 

according to the voltage level supplied from the virtual in-the-ear-canal acoustic measurements via the probe mea- 

electroacoustic audiometer module in response to operating surement system as shown in FIGS. 19-22. The conven- 

clinician test selections. tional method of in-the-ear-canal measurements with hear- 

The ICP is also used in a novel way to test a new type of in S aids involve probe placements beneath the hearing aid 

hearing aids adapted to interface to the ICP, as shown in 25 which subjects the probe to pinching effects, thus affecting 

FIGS. 19-22. Unlike conventional hearing aid and aided the accu racy of the measurement. Furthermore, placing the 

hearing evaluation methods that typically employ remotely P«>be tube beneath the hearing aid creates an acoustic 

positioned speakers to deliver acoustic signals into the lea^kage path which causes oscillatory feedback. Ilie probe 

hearing aid microphone, the ICP of the present invention f ube ca " al °J ^ P^nt invention also provides an 

f K . . \ , on * improved method of advancing the probe while the hearing 

presents acoustic signals directly to the microphone 211 of 30 4U i 

f u u • -j-M/f^u V r c *u * aid is placed in the ear canal. 

the heanng aid 214. The acoustic coupling of the present The OTce of these hases as outlined in Fia 23 

invention spans a minimal distance typically less than 15 repreS ents a typical fitting process unique to the system of 

mm> the present invention. The fitting process offered by the 

FIGS. 19 and 21 show an embodiment of the invention in virtual electroacoustic audiometer system in the preferred 

which acoustic coupling is accomplished via a magnetic 35 embodiment of the present invention is implemented in five 

attraction method. In such method, the ICP receiver 136 is phases: (1) reference measurements 264, (2) unaided hear- 

coupled to the hearing aid microphone 211 via magnetic ing evaluation 265, (3) predicted aided evaluation 266, (4) 

attraction between a magnet disk 206 on the receiver end of simulated aided evaluation 267, and (5) aided evaluation 

the ICP and another magnet disk 209 near the hearing aid 268. However, individual phases or a components of each 

microphone port 210, and which is part of the face-plate 218 40 phase can be administered individually, or in other sequence 

of a hearing aid 214, as shown in FIG. 19. A sealing ring 205 as suitable for the individual under hearing evaluation. Each 

provides acoustic sealing to minimize leakage in the cou- process phase is implemented in a graphical module, as 

pling. Also provided are a hearing aid battery holder 221, a shown in FIGS. 24-28. 

hearing aid volume control 219, a hearing aid circuit 212, The first phase, i.e. reference measurements, is imple- 

and a hearing aid vent canal 217, all representing conven- 45 mented by a reference measurements module (FIG. 24) that 

tional components of a hearing aid device. contains a reference measurement window (shown open in 

Additionally, the embodiment of the invention shown in FIG. 24) and a signal model window (shown iconized in 

FIG. 21 provides a programmable hearing aid circuit 253 FIG. 24), The reference measurement window allows for 

that allows dynamic ITE testing via control signals routed measurements of various transfer functions that are used 

from the VEA over a programming cable 257. FIG. 21 50 later throughout the fitting process. 

shows an electrically programmable hearing aid with a The unaided transfer function U ua (p„, jw) described 

programming cable 257 connecting the hearing aid circuit to above, is measured when the 3D-REUR (3 Dimensional 

the VEA of the present invention. These hearing aids contain Real -Ear Unaided Response) option is selected, 

circuits that are programmable or adjustable, typically via Measurements are obtained from the frontal (facing 

electrical signals. The shown programming interface at the 55 speaker #1) or back (facing opposite speaker #1) 

face-plate is via the battery holder which is adapted to route orientations, depending on the Front/Back option selected, 

programming electrical signals to the hearing aid circuit. Plots of right and left ear transfer functions can be displayed 

The programming signals and interface methods are typi- in either transverse or sagittal plane depending on the 

cally unique to the hearing aid model as provided by the Transverse/Sagittal option selection. FIG. 24 shows a set of 

specification of the hearing aid circuit used. These program- 60 8-p aired H ua (p„, jw) transfer functions in the transverse 

ming signals and interface methods are known to persons plane. The measurement is performed by positioning the 

skilled in the art of hearing aid design. Other programmable individual centrally to the speaker array (discussed above) 

hearing aids currently commercially available employ ultra- and placing right and left probe tubes in their respective 

sonic or infra-red signals with the appropriate signal inter- unoccluded ear canal. 

face circuits within the hearing aid. 65 Another novel feature of the invention is the ability to 

An alternative acoustic coupling method couples the ICP measure and quantify the occlusion effect of the simulated 

receiver 136 to the hearing aid microphone 211 via a hearing aid, as well as the fitted hearing aid. 
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However, before the occluded measurement is taken, a Other combinations of tones, including a single, triple, 

reference measurement with the ear canal unoccluded must composite, and other signals can also be used to implement 

be taken. The procedure, briefly described here, is to request the above procedure of continuously measuring the response 

the individual to utter a vowel, preferably a vowel with high to various acoustic stimuli and detecting an appropriate 

energy contents in its low frequency spectrum, such as "ee." 5 stopping point during probe advancement, with little regard 

A measurement is taken with the probe positioned near the to probe distance to the tympanic membrane. The appropri- 

tympanic membrane. The occlusion effect reference ate probe position is referred to hereafter as the probe 

measurement, i.e. unoccluded, is saved for occlusion effect reference point. 

measurement with the ear canal occluded using either the The second phase, unaided evaluation, is implemented by 

ICPor the hearing aid, as is explained below. The occlusion an unaided evaluation module, shown in FIG. 25, which 

effect reference measurement is performed when the occlu- consists of an unaided analysis window, shown open in the 

sion reference option is selected. figure; a spatialization window, also shown open; a signal 

The face-plate transfer function H fp (p„, jw) (plots not model window, shown iconized; and an audiometric evalu- 

shown) is measured when the Face-Plate Response option is ation window, also shown iconized. 

selected. The ICP is placed in the ear and the probe tube tip The unaided analysis window allows for various in- the- 

is placed in the microphone position 132 of the face-plate as 15 ear-canal measurements and displays for hearing evaluation 

shown in FIG. 13. in the unaided condition while the ICP is inserted in the ear 

The ICP-receiver to real ear transfer function, H- cp . rt?c (jw) canal. Measurements and plots include Audiogram 

is measured when ICP Calibrate option is selected. This spectrum, Distortion, Time Analysis, Spectrogram, and 

requires the probe tube to be inserted in the probe tube canal 2-CC curves. Acoustic stimuli, measurement methods, and 

of the ICP, and the tip of the tube near the tympanic 20 associated plots for these tests are known to persons skilled 

membrane. in the arts of audiology and signal analysis. However, the 

To facilitate the proper placement of the probe in the ear Audibility Spectrogram is a new feature that is unique to the 

canal during various response and calibration present invention as described below, 

measurements, a novel method is employed to optimize such The Audibility Spectrogram is a spectral plot showing the 

probe placement within the ear canal, and specifically to 25 audibility of a signal with respect to the hearing profile of the 

minimize the effects of standing waves present in the ear individual and the critical audibility features of an acoustic 

canal due to wave reflections from the tympanic membrane. signal. The audibility spectrogram is essentially a three- 

The frequency dependent standing wave patterns are well dimensional matrix represented in a two-dimensional plot 

characterized and known to persons skilled in the art of that indicates signal dynamics (time) and Critical Audibility 

acoustics and particularly real ear acoustic measurements. 30 Regions (CAR) versus frequency, as shown in FIG, 25. 

The new method of the invention involves acoustic presen- CARs, shown as the outer contours, are specific to each 

tation of a dual tone, one at a low frequency in the range of signal segment that is selected from the signal model win- 

1 kHz to 5 kHz, and a second at a range of 15 kHz to 20 kHz. dow. CARs of a speech segment are defined by the critical 

The acoustic response to tone signals delivered either via a sound features, such as the energy of significant formats in 

speaker or the ICP receiver, depending on measurement, is 35 vowels, the energy of fundamental frequency of voicing, the 

continuously measured by microphone probe system and energy of aperiodic frequency sounds, and other criteria 

displayed on the monitor, as shown in FIGS. 30-32. known to effect intelligibility, detection, or identification, 

A plot of the acoustic response in an ear of an individual depending on the signal model selected, 

for each tone, shown in FIG. 29, indicates a characteristic The Audibility Spectrogram plots are derived by combin- 

rise in the low frequency response and a notch in the high 40 ing spectrograms of analyzed signals and defined CARs, and 

frequency response as the probe is advanced closer to the probe measured spectrograms computed and compared with 

tympanic membrane. This notch occurs at approximately 5 the measured hearing profile of the individual at the CARs. 

mm from the tympanic membrane for the 15 kHz tone. Measured spectrogram values that fall below the threshold 

Monitoring of the relative response characteristics during of hearing for the individual are assigned to Below Thresh- 

probe insertion provides a visual and computer-assisted 45 old (B-Thresh) values which define the outer contour region, 

method to indicate proper probe positioning as shown in the within the CAR; while measured spectrogram values that 

spectrum plots of FIGS. 30-32. The end of this procedure is exceed the threshold of hearing within CAR are assigned 

generally indicated when a significant notch, typically Above Threshold (A-Thresh) values which define a region 

exceeding 15 dB as shown in FIG. 31, followed by a within the Below Threshold region; and measured spectro- 

significant rise in the high frequency, ie. second tone, 50 grams values that exceed the uncomfortable loudness level 

response. (UCL) of the individual are assigned Above-UnComfortable 

The low frequency, i.e. second tone, response shows only Loudness level (A-UCL) values which define the inner-most 

a small increase, within 3 dB, as the probe is inserted closer contour regions. 

to the tympanic membrane. Although probe tip to tympanic The resulting color-coded plot is typically contour shaped 

membrane distance approximation is possible with this 55 for speech signals. 

procedure, the object of this procedure is to position the However, any type of acoustic signal can be assigned 

probe such that minimal standing waves are present at CARs and a corresponding audibility spectrogram based on 

frequencies of interest during transfer function measure- the individual's measured hearing profile. The objective of 

ments. For example, if unaided response measurements up the Audibility Spectrogram plot is to provide a quick graphi- 

to 6 kHz are desired, advancing the probe until detecting a 60 cal means of indicating the audibility of dynamically 

notch in 15 kHz response ensures measurement errors not to received acoustic signals by taking in consideration the 

exceed 2.5 dB at 6 kHz. Improved accuracy can be achieved individual's hearing profile and the critical audibility fea- 

by selecting a higher frequency for the second tone, although tures of a signal model. This plot is particularly important in 

this increases the chance of advancing the probe too far, hearing aid fitting optimization processes during predicted 

resulting in touching the surface of the tympanic membrane, 65 aided, simulated aided, and aided evaluation, 

an occurrence that is generally safe but that may cause The spatialization window permits selection of signal 

discomfort. presentation mode, either in Spatialized or Intracranial 
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modes. Spatialized mode presents selected sources and 
background signals to be delivered to both ears via inserted 
I CPs according to the selected spatial relationship of head, 
sources, background, and boundaries, as shown in FIG. 25. 
Spatial relationships include the distance between the audio 5 
source and the head reference point (d), azimuth angle (0), 
and altitude angle (a). 

Various individual and calibration transfer functions are 
employed to synthesize audio signals with realistic listening 
effects. Signal sources and corresponding levels are selected 10 
from the Signal Model window (not shown). Intracranial 
mode, on the other hand, offers the conventional sound 
presentation method where selected signals and correspond- 
ing levels are delivered without spatialization to one or both 
ears. 15 

The Signal Model window permits the selection of source 
and background signals and corresponding level. Source 
selection may be of pure tone type, speech, music, or any 
signal of audiological significance. Background signals are 
typically competing speech, environmental noise, and other 20 
signals of audiological significance. The level of signals 
selected in the spatialized mode is preferably in dB SPL 
calibrated to 1 meter from the source in free field. The 
measured in-the-ear-canal acoustic response is preferably 
displayed in dB SPL as measured by the probe microphone 25 
system. 

In the intracranial mode, source and background signals 
are routed to right, left, or booth ears as in conventional 
audiometry. The level of signals selected in the intracranial 
mode is preferably in dB SPL. The H fc c (jw) transfer 30 
function measurement via the ICP calibration procedure 
described above permits level selection in dB SPL. 
Furthermore, measurements via the probe microphone sys- 
tem can be made as needed to ensure that the probe and the 
ICP remain properly positioned in the ear canal. 35 

A specific selection of source and background signal type, 
levels, and spatialization mode is defined as a signal model. 
One or more signal models can be selected, saved, and 
retrieved by the system for presentation and analysis pur- 
poses. A signal model can represent any individual or a 40 
combination of acoustic signals/scenarios, including speech, 
background noise, music, pure tone, masking noise, com- 
posite signals, and other audiologically significant signals. 

The audiometric evaluation window, shown iconized, 
allows for various conventional audiometric measurements 45 
to be taken. This includes threshold audiogram, most com- 
fortable level (MCL), uncomfortable loudness level (UCL), 
speech reception threshold (SRT), and various other audio- 
metric measures known to persons skilled in the art of 
audiology. However, unlike conventional audiometry where 50 
transducers are calibrated in various acoustic couplers and 
measurements are measured in relative hearing level (HL) 
terms , the preferred method measures the in-the-ear-canal 
response in absolute sound pressure level (SPL) terms. 

Another feature of the invention relates to the modes of 55 
audiometric signal presentation. As described above, spa- 
tialized or intracranial listening modes selected from the 
Spatialization window, not only affect the presentation 
selected from the Signal Model window, but also the Audio- 
metric Evaluation window as well. For example, a standard 60 
audiological word list such as NU-6 or W-22, commonly 
used in conventional speech audiometry, can be presented in 
the conventional intracranial mode, or alternatively, in the 
spatialized mode unique to the invention. 

The signal process of a spatialized unaided evaluation 65 
involves the unaided transfer function H MQ (p„, jw), inter- 
polated based on selections of the spatialization window, and 
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the H IC/ _ rec (jw) transfer function. A signal process imple- 
mentation of a particular spacialized unaided evaluation is 
shown in FIG. 10. 

The third phase, the predicated aided evaluation, is imple- 
mented by the predicated aided evaluation module. This 
module, shown in FIG. 26, allows the operating clinician to 
select a hearing aid and predict its performance without the 
involvement of the hearing-impaired individual. The module 
consists of a Hearing Aid Select/Adjust window, shown 
open; a Predicated Analysis window, shown open); a Signal 
Model window, shown iconized; a Spatialization window, 
shown iconized;and the Audiometric Evaluation module. 
The Signal Model, Spatialization, and Audiometric Evalu- 
ation windows are essentially identical to those described in 
the Unaided Evaluation phase. 

The Hearing Aid Select/ Adjust window permits hearing 
aid selection and subsequent adjustment. The predicated 
results of the selection/adjustment are shown on the selected 
plotsof the adjacent Predicted Analysis window. Hearing aid 
selection can be automatic or manual, depending on the 
hearing aid selection Automatic/Manual option selected. 
Automatic selection involves selecting one or more hearing 
aids based on the fitting algorithm selected, and various 
other criteria selected by the hearing-impaired and the 
operating clinician. Conventional fitting formulae and 
methods, such as POGO, Berger, and NAL-II, are provided. 

The preferred fitting method is the dynamic audibility 
method which employs a rational such that Audibility Spec- 
trogram is optimized. This corresponds to plots that maxi- 
mize the Above-Threshold (A-Thresh) contour areas while 
minimizing Bellow-Threshold (B-Thresh) and Above- 
Un Comfort able loudness Level (AUCL) contour areas. 
Hearing aid models that best match the selected criteria are 
automatically retrieved from the system memory. 

Alternatively, manual selection can be made by choosing 
one or more hearing aid models from the available list of 
models. A hearing aid model contains all of the necessary 
electroacoustic parameters that are used for signal process- 
ing of a signal model. The results of the signal process are 
used in the Predicted Analysis window for analysis and 
plotting purposes. Hearing aid parameters of a selected 
hearing aid model are adjusted automatically or manually 
depending on the hearing aid adjustment Automatic/Manual 
option and the fitting method selected. 

A hearing aid control parameter set is typically unique to 
the hearing aid model selected. In the example window 
shown in FIG. 26 with hearing aid model DigiLink 100 
selected, the control parameters are: volume control (VC), 
Low Frequency Cut (LFL), compression Threshold Knee 
(TK), Microphone type (MIC), Receiver type (REC), and 
Vent Size selection which reflects vent size of the ICP 
inserted. If a different vent size is selected, either manually 
via the vent insert selection, or electronically via the pro- 
grammable micro-valve vent selection, a new H icp _ spfcr (jw) 
transfer function is preferably measured to improve the 
accuracy of the analysis. 

The predicted analysis window is essentially identical to 
the unaided analysis window, described above, with the 
exception of the signal processing model that includes the 
measured face-plate transfer function Yi fp (p„, jw) (292, 293; 
FIG. 33), hearing aid transfer function ¥L ha (jw) (294; FIG. 
33), and the measured ICP receiver to real-ear ^ icp ^ rec (jw) 
transfer function for the aided ear (295; FIG. 33). The 
hearing aid H /ia (jw) transfer function is typically non-linear 
and varies depending on the hearing aid selected. The total 
hearing aid transfer function U ha . t (jw) typically includes 
transfer functions of the microphone H, m - C (jw), hearing aid 
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circuit H Afl . rec (jw), and the receiver H^ a .^ c (jw). The Another measurement unique to the invention is that of 

transfer function U ha (jw) differs from U ha _ ( (jw) by exclud- acoustic feedback caused by acoustic leakage from the ICOP 

ing the hearing aid receiver and, instead, including a receiver receiver, when simulating a hearing aid receiver, to the 

correction transfer function H^ c . corr (jw), that defines the face-plate of the ICP, which simulates the face-plate of the 

difference between the predicted hearing aid receiver and the 5 hearing aid. The transfer function H^^Qw) (338; FIG. 37), 

ICP receiver employed. This correction transfer function e.g. amplitude and phase response, is measured at the 

^Rec-corr G w ) * s typically a linear transfer function and is face-plate as described above. The opening created by the 

supplied by the VEA system, removal of the probe tube from the ICP probe tube canal is 

The predicted aided analysis process for an aided right ear preferably plugged during the feedback measurement to 

and unaided left ear for a child-listener/teacher-talker see- exclude acoustic leakage due to the probe canal, 

nario is shown in FIG. 33. The results of the digital signal A significant application of the feedback transfer function 

process are stored in the system memory 106 for analysis is in the simulation, and thus prediction, of oscillatory 

and display. feedback of the simulated hearing aid. This undesirable 

The analysis of the predicted data in the system memory oscillatory feedback manifests itself in the form of 

includes audibility analysis as described above. The plotting whistling, which interferes with the normal operation of the 

includes an Audibility Spectrogram that indicates audibility 15 hearing aid. The prediction and simulation of the oscillatory 

contours of Below-Threshold, Above-Threshold and Above- feedback of a simulated hearing aid having a selected setting 

UCL with respect to critical audibility regions (CRAs). FIG. is accomplished by incorporating the ICP feedback transfer 

26 shows improved audibility in the predicted aided condi- function H lc/ ,_/&G w ) 337, as shown in FIG. 37. 

lion versus unaided condition shown in FIG. 25, ie. Oscillatory feedback can be audible to the individual 

increased Above-threshold contour areas. 20 wearing the ICP via the ICP receiver. The oscillatory feed- 

Another prediction measurement unique to the present back can also be measured via the ICP microphone system 

invention, is the measurement of occlusion effect caused by in conjunction with the VEA system. This feature allows the 

the insertion of the ICP into the ear canal that is character- operating clinician to adjust the settings of the simulated 

ized by the perceived amplification of the person's own hearing aid, particularly the gain, frequency response, and 

voice. The present invention provides a method of 25 vent size, such that oscillatory feedback is minimized or 

measuring, subjectively and objectively, the magnitude of eliminated. Similarly, the VEA system can be employed to 

the occlusion effect. The subjective method is performed by select automatically an alternate hearing aid or alternate 

asking the individual wearing the ICP to evaluate his own hearing aid parameter set, such that oscillatory feedback is 

voice when speaking. If the response is objectionable to the minimized or eliminated. 

hearing-impaired candidate then an alternative ICP, repre- 30 The predicted aided analysis window also includes other 

senting a different hearing aid, may be considered. analysis and corresponding plots of Audiogram, Distortion, 

The objective method involves the measured response via Time Analysis, Spectrogram, 2-cc Curve. These are stan- 

the probe system in the occluded ear canal and subtracting dardized measurements and plots that are known to persons 

the occlusion effect reference measurement, ie. uoccluded skilled in the art of hearing sciences and technology. The 

ear-canal measurement, as described above. 35 2-cc coupler curves involve conversion of measured in-the- 

The patient microphone 57, external to the ear canal, is ear-canal response to standard 2-cc coupler curves using 

typically employed to record the individual's own voice real-ear- to-2-cc coupler conversion formulas. Standard sig- 

during occlusion effect measurements to ensure constant nal models, such as pure tones, are typically involved in the 

intensity level during both unoccluded and occluded ear 2-cc coupler measurements (see Specification of Hearing 

canal measurements (see Mueller, H. G., Hawkins, D. B,, 40 Aid Characteristics, ANSIS3.22-1987, American Standards 

Northern, J. L., Probe Microphone Measurements: Hearing National Institute), Other evaluation methods conceived and 

Aid Selection and Assessment, 1992, pp. 221-224). Aunique well within the means of the invention include the Articu- 

feature of the present invention is to eliminate not the only lation Index (AI) measures for unaided, predicted aided, 

requirement of constant voice intensity, but also constant simulated aided, and aided conditions, 

voice spectral characteristics. This is accomplished by 45 An objective of the predicted aided module is to predict 

adjusting the calculated occlusion effect measurement by the objectively the performance of a selected hearing aid 

difference in the spectral characteristics of the individual's according to the selected signal model, selected hearing aid 

own voice. parameter set, and the individual's hearing profile, without 

It is known in the field of audiology that deep hearing aid the involvement of the hearing-impaired individual, 

insertion substantially reduces the occlusion effect, partial- 50 The fourth phase, simulated aided evaluation, is imple- 

larly at low frequencies in the range of 125 to 1000 Hz. mented by the simulated aided evaluation module, as shown 

Therefore, a smaller ICP, representing a smaller simulated in FIG. 27. This module allows the operator to select and 

hearing aid, may be used for subsequent evaluation phases. optimize one or more hearing aids and simulate their audible 

The occlusion effect created by two types of ICP, i.e. characteristics. The module consists of a Hearing Aid Simu- 

ICP-ITC and ICP-ITE, is shown in the plot of FIG. 27. This 55 lation window, shown open; a Simulated Aided Analysis 

plot indicates a significant occlusion effect due to the ICP- window, shown open; a Signal Model window, shown 

ITE versus the ICP-ICP for an individual. This is expected iconized; a Spatialization window, shown iconized; and the 

since the ICP-ITE creates a greater residual volume, to Audiometric Evaluation module, shown iconized. The Sig- 

which the occlusion effect is known to be directly propor- nal Model, Spatialization, and Audiometric Evaluation win- 

tional. 60 dows are essentially identical to those described above. The 

The advantage of I CP measurement at me probe reference Simulation Aided window is essentially identical to the 

point is that all measurements taken are independent of the Hearing Aid Select/Adjust window of the Predicted Aided 

ICP selected or its placement in the ear canal. However, to Evaluation module. Similarly, the Simulated Aided analysis 

present accurate spatialized sounds to the individual, the window is essentially identical to the Predicted Analysis 

^icp rcc G w ) transfer measurement is required whenever a 65 window. 

new ICP is selected and inserted into the ear canal of the A major difference in the simulated aided evaluation 

individual. module is the module's ability to synthesize simulated aided 
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conditions and to present the audible results to the hearing- 
impaired individual. Another significant difference is that 
analysis is performed by the module based on measured, 
rather than predicted, data. The measured response is 
obtained via the microphone probe measurement system 5 
with the probe tip placed at the probe reference point, as 
discussed above. 

An example of a simulated aided signal process, shown in 
FIG. 34, involves the transfer function of the hearing H ha 
(jw) that includes the U Rec , corr (jw), and the face-plate 10 
transfer function H fp (p„, jw) for simulation of the aided ear. 
The results of the process are converted to analog signals via 
the digital-to-analog-converter 115 and routed to the right 
and left I CPs, 119 and 120 respectively, inserted in the ear 
canals of the individual. 

If the microphone of the predicted hearing aid is of 
directional type, then separate microphone transfer 
functions, representing its directional properties are 
employed, as shown in FIG. 35. A digital audio file 107 is 
retrieved from the system memory 106 and processed with 
face-plate transfer functions H^Xp^jw) (310; FIG. 35) and 
H //? (l>2> jw) (312; FIG. 35), where p a and p 2 represent two 
points in a three-dimensional space. Signal paths from pj 
and p 2 may represent direct and primary reflective paths, 
respectively. Secondary reflective paths p 3 , p 4 , . . . , p„ (not 
shown) can be similarly represented in the digital signal 
process. 

The results of each face-plate transfer function step are 
further processed with the corresponding microphone trans- 
fer function 318, 320 for each signal path from points p 2 , p 2 , 
. . . p„. The results are summed 326 and are processed by the 
hearing aid circuit transfer function H, M _ c/r (jw) 322, U Rec _ 
corr (jw) 324, as shown in FIG. 35. The resulting digitally 
processed signal is then converted to analog signal via the 
digital-to-analog converter 115 and routed to the appropriate 
I CP within the ear canal via the audiometric transducer 
interface 117. 

The simulated aided analysis window includes measure- 
ments and corresponding plots of Audiogram, Distortion, 
Time Analysis, Spectrogram, Audibility Spectrogram, 2-cc 
Curve, Occlusion Effects, and Feedback Analysis. These 
measurements are essentially identical to those described 
above for the predicted analysis window. This process is 
based on the system's ability to compute a hearing aid 
prescription based on a selected fitting prescription formula/ 
rational. The selected hearing aid can be adjusted and results 
analyzed and plotted with or without the involvement of the 
hearing-impaired individual. 

An objective of the simulated aided module is to optimize, 
objectively and subjectively, the performance of a selected 
hearing aid according to measured in-the-ear-canal probe 
response as a function of the selected signal model, hearing 
aid parameter set, the individual's measured hearing profile, 
and subjective responses to the presented audible signal. 

One feature unique to the invention is the ability to 
compute the characteristics of a simulated monaural or 
binaural hearing aid system that produces natural sound 
perception and improved sound localization ability to the 
hearing impaired individual. This is accomplished by select- 
ing a simulated hearing aid transfer function that produces, 
in conjunction with the face-plate transfer function, a com- 
bined transfer function that matches that of the unaided 
transfer function for each ear. The matching requirement 
typically involves frequency and phase responses. However, 
the magnitude response is expected to vary because most 
hearing impaired individuals require amplification to com- 
pensate for their hearing losses. 
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Once the hearing aid selection and optimization processes 
are completed via VEA system simulation, the characteris- 
tics of the simulated hearing aid are translated to hearing aid 
specifications for manufacture/assembly. 

Manufacturing specifications include: hearing aid com- 
ponents simulated by the VEA system, including the micro- 
phone and receiver; shape and size of hearing aid according 
to the ICP selected; hearing aid circuit blocks and circuit 
components; hearing aid parameter setting; and vent type/ 
size. An objective of the VEA system is to provide a detailed 
specification to the manufacturer/assembler to manufacture/ 
assemble a monaural or binaurally matched hearing aid 
system that closely matches the preferred simulated hearing 
aid. Ordering of the actual hearing aid is performed from the 
Order menu shown in FIG. 27 which provides a printout of 
detailed hearing aid specification. 

The final step in the process, aided evaluation, is repre- 
sented by the aided evaluation module as shown in FIG. 28. 
This module consists of an Aided Evaluation window, 
20 shown open, an Aided Analysis window, shown open; an 
Audiometric Evaluation window, shown iconized; a Signal 
Model window, shown iconized; and a Spatialization 
window, shown iconized. The latter three windows are 
essentially identical to those in the predicted aided evalua- 
25 tion and simulated aided evaluation windows. The aided 
evaluation window permits electronic adjustment of manu- 
factured hearing aid parameters as in the case of a program- 
mable hearing aid, shown in FIG. 21, or displaying the 
suggested parameter setting in the case of a manually 
30 adjusted hearing aids, shown in FIG. 20. 

The aided analysis window is similar to the analysis 
window for unaided, predicted aided, and simulated aided 
evaluation process steps, except that the measurements and 
corresponding plots reflect the response from the actual 
35 hearing aid inserted in the ear canal of the individual rather 
than predicted or synthesized signal, i.e. simulated aided, 
response analysis. 

Synthesized realistic acoustic signals are presented to the 
hearing aid by coupling spatialized sounds directly to the 
40 microphone of the hearing aid, as shown in FIGS. 19-21. 
The face-plate transfer function, (p M , jw), and the sup- 
plied ICP receiver-to-microphone transfer function H IC/ ,. m(C 
(jw) are employed in the digital synthesis process, as shown 
in FIG. 36. A digital audio file 107 representing an audio 
45 source at location p„ in space is retrieved from the system 
memory 106 for processing with the free-field to face-plate 
transfer function U fp (p„, j w) 340, 342 for right and left ears, 
individually. Other parallel processes reflecting filtering of 
additional audio sources or filtering of reflective paths, 
50 shown collectively in the dashed rectangles 341, 343, are 
summed with the right 112 and left 113 summing nodes. The 
outcome of summing nodes is further processed to equalize 
the ICP receiver to hearing aid microphone coupling effects 
by applying the inverse transfer function 1/H icp ^ mic (jw) 344, 
55 345. The acoustic signals supplied to the microphones 350 
of the hearing aids 351 represent spatialized signals with 
characteristics selected and controlled by the VEA system 
operator via the Spatialization, Signal Module, and Audio- 
metric Evaluation windows. 
60 Electroacoustic testing of the hearing aid, coupled with 
the ICP as described above, may also be performed external 
to the ear canal, for example 2-cc coupler measurements can 
be performed by connecting the receiver output of the 
hearing aid to the 2-cc coupler input. The ICP, in conjunction 
65 with the signal generation capability of the VEA, can 
produce various acoustic stimuli as input to the hearing aid 
during its 2-cc coupler-based hearing aid evaluation. 
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Similarly, 2-cc coupler measurements can be performed on 
the ICP, i.e. a simulated hearing aid, by connecting the 
receiver output of the ICP to the 2-cc coupler input. 

The invention not only deals effectively with today's 
diagnostic and fitting problems but also provides a basis for 5 
new tools that are audiologically significant. For example, 
the system's ability to synthesize realistic acoustic 
conditions, both simulated aided and aided, can be used as 
an auditory rehabilitative tool where a hearing impaired 
listening ability is improved by interactive training. In such 10 
application, the hearing impaired person is presented with 
spatialized signals that represent spoken words in noisy 
background. Even though the words might be audible as 
determined from the audibility measurements and methods 
described above, these words might not be intelligible for 15 
the untrained hearing-impaired individual. Depending on the 
verbal response, or registered response via a response 
keypad, the VEA system can provide audible or visual 
feedback to the hearing impaired individual that indicates 
the appropriateness of the response. The object of this new 20 
tesl is to teach the hearing-impaired how to improve speech 
perception and intelligibility beyond mere audibility. 

Another test made possible by the invention determines 
the individual's ability to localize a sound in a plane or in 
three-dimensional space. An example is the detection of 25 
minimal audible angle (MM) test whereby the individual's 
ability to detect, in degrees, the minimal angular separation 
of pure tones versus frequency (see Mills, A. W., On the 
Minimum Audible Angle, Journal of Acous. Soc. of Am. 
30:237-246, 1956). Furthermore, a comparison of the indi- 30 
vidual's localization ability can be compared across 
unaided, simulated aided, and aided conditions. 

The invention also makes it possible to determine the 
individual's ability to detect sound movements in a plane or 
in a three-dimensional space. For example, a sound object 35 
can be synthesized to represent movement in a particular 
geometrical and frequency pattern. The individual's 
impaired ability to detect the movement can be assessed. 
Furthermore, a comparison of the individual's ability to 
detect sound movements can be compared across various 40 
listening conditions in the unaided, simulated aided, and 
aided conditions. 
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Although the invention is described herein with reference 
to the preferred embodiment, one skilled in the art will 
readily appreciate that other applications may be substituted 
for those set forth herein without departing from the spirit 
and scope of the present invention. Accordingly, the inven- 
tion should only be limited by the Claims included below. 
I claim: 

1. A method for selecting and presenting binaural acoustic 
stimuli in spatialized mode for hearing diagnostics and 
rehabilitation, comprising the steps of: 

synthesizing audio signals, including primary audio sig- 
nals comprising pure tones and speech, and secondary 
audio signals comprising background noise and other 
competing sources, wherein said synthesized audio 
signals are presented according to individualized trans- 
fer functions that include a hearing aid faceplate, and 
any of an individual's effects of body, head, and ear on 
incoming signals; 
controlling spatialization parameters of said audio signals, 
including any of the position of each source in space in 
terms of any of distance, azimuth, and altitude; and 
acoustic boundary parameters including room size, 
reflection properties, reverberation, atmospheric 
absorption, and spreading loss roll-off; 
presenting such spatialized stimuli to an individual; and 
performing any of hearing diagnostics, hearing aid 
prescription, hearing aid simulation, and hearing aid 
fitting with an audiometric module. 

2. The method of claim 1, further comprising the step of: 
presenting such spatialized stimuli to predict performance 

of one or more hearing aid systems. 

3. The method of claim 1, further comprising the step of: 
presenting such spatialized stimuli for simulating a hear- 
ing aid system. 

4. The method of claim 1, further comprising the step of: 
presenting such spatialized stimuli for hearing aid evalu- 
ation. 

***** 



